-- Logs begin at Wed 2021-12-15 12:56:27 UTC, end at Wed 2021-12-15 13:53:27 UTC. -- Dec 15 13:28:04.889739 dv-cinder-813228-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 13:28:04.898316 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 13:28:04 2021] *** Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: nodename: dv-cinder-813228-4-iscsi Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: machine: x86_64 Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: clock source: unix Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: pcre jit disabled Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: detected number of CPU cores: 4 Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: current working directory: / Dec 15 13:28:04.900270 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: detected binary path: /usr/bin/uwsgi-core Dec 15 13:28:04.900962 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: your processes number limit is 47680 Dec 15 13:28:04.900962 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: your memory page size is 4096 bytes Dec 15 13:28:04.900962 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: detected max file descriptor number: 2048 Dec 15 13:28:04.900962 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: lock engine: pthread robust mutexes Dec 15 13:28:04.900962 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: thunder lock: enabled Dec 15 13:28:04.900962 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 13:28:04.900962 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 13:28:04.944774 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: Python main interpreter initialized at 0x55d540c3f9c0 Dec 15 13:28:04.944774 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: python threads support enabled Dec 15 13:28:04.944774 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: your server socket listen backlog is limited to 100 connections Dec 15 13:28:04.944774 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: your mercy for graceful operations on workers is 90 seconds Dec 15 13:28:04.945091 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 13:28:04.945165 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: *** Operational MODE: preforking *** Dec 15 13:28:04.945384 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: *** uWSGI is running in multiple interpreter mode *** Dec 15 13:28:04.945384 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: spawned uWSGI master process (pid: 101954) Dec 15 13:28:04.945602 dv-cinder-813228-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 13:28:04.948327 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: spawned uWSGI worker 1 (pid: 101955, cores: 1) Dec 15 13:28:04.948327 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: spawned uWSGI worker 2 (pid: 101956, cores: 1) Dec 15 13:28:04.948327 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 13:28:06.660734 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:28:06.660734 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: from cryptography.utils import int_from_bytes Dec 15 13:28:06.661297 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:28:06.661297 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: from cryptography.utils import int_from_bytes Dec 15 13:28:06.684867 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:28:06.684867 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: from cryptography.utils import int_from_bytes Dec 15 13:28:06.685492 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:28:06.685492 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: from cryptography.utils import int_from_bytes Dec 15 13:28:09.244786 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:28:09.245362 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:28:09.245723 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:28:09.246001 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:28:09.246258 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:28:09.246646 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.246971 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.247136 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:28:09.247518 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.247610 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:28:09.247679 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.247891 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:28:09.247996 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.248214 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.248298 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:28:09.248513 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:28:09.248605 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.249351 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.249448 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.249684 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.249797 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.249972 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.250079 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.250288 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.250406 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.250623 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813228-4-iscsi {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.250834 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.250920 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.251046 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.251230 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.251371 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.251541 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.251699 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.251859 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.252032 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.252163 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.252298 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.252483 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.252620 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.252789 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.252948 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813228-4-iscsi {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.253276 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.253366 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.253591 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.253737 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.253935 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.254067 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.254259 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.254378 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.254568 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.254715 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.254895 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.255030 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.255205 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.255339 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.255659 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.255742 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.255967 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.256052 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.256288 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.256435 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.256597 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.256993 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.256993 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.257365 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813228-4-iscsi {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.257365 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258040 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258176 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258270 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258391 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258514 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258514 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258712 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258712 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.258908 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.259037 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.259128 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.259249 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.259417 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813228-4-iscsi {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.259531 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.259661 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.259837 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.259955 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.260161 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.260276 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.260478 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.260698 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.260782 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.261040 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.261188 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.261387 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.261547 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.261691 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.261797 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.262026 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.262115 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.262345 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.262438 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.262648 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.262731 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.262952 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.263038 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.263203 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.263299 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.263901 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.264011 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.264092 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.264219 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.264309 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.264401 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.264480 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.265172 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.265264 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.265381 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.265482 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.265677 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.265823 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.266022 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.266107 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.266282 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.266409 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.266597 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.266718 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.266926 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.267009 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.267622 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.267852 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.267947 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268035 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268119 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268198 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268284 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268370 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268448 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268525 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268699 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.268794 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.269011 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.269102 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.269325 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.269411 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.269638 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.269731 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.269975 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.270063 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.270285 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.270370 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.270597 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.270691 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.270909 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.270993 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.271220 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.271345 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.271547 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.271655 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.271853 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.271947 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.272171 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.272265 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.272480 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.272572 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.272782 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.272874 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.273089 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.273190 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.273396 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.273489 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.273716 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.273834 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.274239 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.274345 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.274435 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.274515 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.275079 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.275172 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.275436 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.275524 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.275659 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.275743 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.275864 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.275953 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.276033 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.276120 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.276200 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.276303 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.276381 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.276621 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.276718 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.276938 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.277028 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.277245 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.277339 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.277497 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.277593 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.277828 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.277917 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.278144 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.278242 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.278534 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.278631 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.278787 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.278887 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.279070 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.279162 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.279375 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.279460 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.279695 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.279795 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.279987 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.280107 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.280321 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.280413 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.280627 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.280710 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.280933 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.281017 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.281238 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.281385 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.281545 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.281649 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.281874 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.281961 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.282462 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.282738 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.282738 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283161 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283161 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283367 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283454 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283544 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283624 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283702 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283792 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.283872 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.284000 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.284097 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.284270 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.284356 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.284571 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.284660 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.284878 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.284982 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.285196 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.285282 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.285503 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.285596 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.285836 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.285937 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.286143 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.286228 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.286604 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.286709 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.286790 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.286876 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.287045 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.287130 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.287348 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.287436 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.287652 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.287742 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.287951 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.288035 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.288268 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.288362 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.288582 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.288666 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.288888 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.288970 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.289193 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.289283 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.289498 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.289588 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.289826 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.289914 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.290141 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.290366 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.290469 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.290551 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.290747 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.290831 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.291051 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.291143 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.291376 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.291460 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.291702 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.291786 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.292019 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.292111 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.292332 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.292416 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.292642 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.292726 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.292964 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:28:09.293060 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.293272 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.293391 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.293584 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.293668 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.293919 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.294010 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.294236 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.294323 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.294551 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.294645 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.294882 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.294968 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.295198 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.295283 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.295513 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.295631 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.295860 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.295947 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.296173 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.296257 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.296489 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.296596 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.296810 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.296895 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.297126 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.297211 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.297434 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.297524 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.297775 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.297874 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.298119 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.298204 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.298433 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.298539 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.298757 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.298843 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.299069 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.299153 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.299382 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.299485 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.299689 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.299779 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.300000 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.300090 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.300312 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.300405 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.300641 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.300726 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.300950 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.301142 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.301276 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.301430 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.301581 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.301812 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.301912 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.302155 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.302240 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.302520 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.302609 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.302824 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.302911 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.303126 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.303227 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.303434 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.303570 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.303768 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.303961 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.304203 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.304779 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.304889 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.304889 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.305086 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.305165 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.305242 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307043 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307172 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307266 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307349 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307434 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307513 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307600 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307679 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307756 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307834 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.307911 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308066 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308154 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308234 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308234 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308373 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308438 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308584 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308668 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308746 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308822 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308897 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.308974 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.309066 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.309145 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.309222 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.309415 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.309508 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.309728 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.309851 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.310064 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.310157 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.310374 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.310507 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.310685 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.310772 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.311011 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.311094 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.311839 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.311937 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.312164 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.312253 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.312494 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.312581 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.312806 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.312899 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.313117 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.313203 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.313437 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.313521 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.313774 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.313917 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.314097 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.314187 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.314402 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.314516 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.314716 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.314813 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.315024 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.315109 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.315331 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.315415 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.315637 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.315729 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.315949 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.316034 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.316255 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.316340 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.316558 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.316651 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.316861 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.316989 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.317166 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.317257 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.317467 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.317560 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.317818 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.317909 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.318120 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.318208 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.318422 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.318519 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.318725 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.318815 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.319031 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.319119 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.319350 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.319433 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.319733 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.319894 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.320008 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.320095 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.320344 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.320440 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.320652 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.320738 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.320971 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.321053 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.321548 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.322107 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.322107 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.322332 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.322416 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.322540 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.322631 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323000 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323000 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323201 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323286 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323421 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323504 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323626 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323743 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323846 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.323979 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.324075 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.324291 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.324386 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.324617 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.324711 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.324929 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.325021 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.325250 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.325334 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.325554 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.325638 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.325898 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.326035 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.326241 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.326333 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.326572 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.326656 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.326885 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.326976 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.327770 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.327886 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.328085 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.328173 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.328403 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.328490 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.328714 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.328800 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.329033 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.329125 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.329344 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.329430 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.329654 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.329739 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.329999 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.330083 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.330309 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.330396 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.330625 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.330761 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.330935 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.331020 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.331256 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.331342 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.331564 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.331655 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.331881 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.331974 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.332185 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.332275 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.332501 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.332594 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.332819 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.332913 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.333147 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.333233 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.333455 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.333546 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.333817 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.333921 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.334109 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.334196 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.334415 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.334498 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.334726 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.334819 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.335039 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.335123 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.335344 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.335487 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.335650 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.335830 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.335961 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.336171 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.336275 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.336517 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.336610 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.336839 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.336931 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.337163 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.337248 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.337473 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.337638 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.337803 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.337892 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.338111 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.338198 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.338414 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.338507 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.338724 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.338814 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.339041 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.339132 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.339348 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.339440 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.339668 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.339751 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.339987 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.340070 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.340288 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.340372 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.340593 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.340678 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.340910 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.340993 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.341215 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.341305 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.341520 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.341604 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.341849 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.341936 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.342156 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.342243 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.342482 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.342566 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.342830 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.342935 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.343132 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.343216 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.343448 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.343532 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.343770 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.343864 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.344077 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.344208 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.344393 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.344477 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.344702 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.344794 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.345009 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.345092 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.345321 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.345407 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.345630 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.345725 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.345966 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.346054 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.346277 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.346363 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.346587 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.346681 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.346896 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.346987 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.347204 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.347288 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.347524 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.347609 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.347830 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.347913 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.348140 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.348224 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.348447 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.348532 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.348749 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.348833 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.349063 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.349146 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.349379 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.349464 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.349692 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.350038 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.350136 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.350356 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.350448 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.350674 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.350765 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.350990 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.351074 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.351332 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.351462 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.351629 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.351725 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.351943 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.352027 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.352255 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.352340 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.352562 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.352644 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.352866 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.352956 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.353173 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.353444 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.353534 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.353779 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.353867 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.354102 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.354190 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.354408 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.354493 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.354716 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.354800 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.355020 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.355106 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.355330 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.355421 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.355635 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.355719 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.355938 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.356025 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.356269 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.356354 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.356574 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.356667 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.356887 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.356978 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.357188 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.357271 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.357498 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.357588 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.357824 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.357942 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.358141 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.358712 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.358956 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.359040 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.359260 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.359354 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.359567 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.359652 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.359869 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.359953 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.360207 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.360291 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.360509 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.360602 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.360828 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.360920 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.361141 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.361238 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.361460 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.361552 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.361796 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.361884 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.362096 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.362259 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.362420 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.362530 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.362723 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.362809 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.363024 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.363117 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.363325 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.363417 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.363632 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.363717 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.363938 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.364035 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.364239 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.364325 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.364548 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.364641 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.364854 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.364940 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.365160 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.365245 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.365464 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.365548 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.365772 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.365860 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.366096 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.366191 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.366399 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.366551 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.366710 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.366867 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.367014 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.367187 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.367314 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.367503 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.367599 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.367812 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.367897 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.368129 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.368219 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.368446 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.368540 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.368760 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.368845 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.369064 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.369150 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.369370 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.369454 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.369670 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.369783 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.369998 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.370085 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.370301 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.370386 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.370611 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.370696 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.370920 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.371003 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.371218 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.371306 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.371534 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.371617 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.371837 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.371933 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.372141 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.372226 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.372442 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.372526 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.372746 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.372840 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.373043 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.373127 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.373344 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.373435 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.373652 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.373743 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.374545 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.374638 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.374864 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.374948 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.375170 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.375267 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.375476 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.375560 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.375776 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.375860 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.376082 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.376168 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.376385 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.376469 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.376692 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.376775 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.376995 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.377080 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.377296 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.377381 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.377594 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.377678 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.377922 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.378011 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.378225 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.378310 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.378545 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.378640 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.378852 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.378939 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.379154 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.379238 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.379460 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.379553 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.379757 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.379848 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.380073 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.380157 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.380386 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.380477 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.380694 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.380778 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.381002 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.381087 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.381313 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.381406 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.381624 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.381715 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.381965 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.382061 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.382275 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.382367 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.382585 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.382670 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.382887 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.382971 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.383200 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.383292 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.383509 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.383594 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.383820 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.383905 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.384120 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.384206 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.384422 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.384530 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.384742 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.384830 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.385050 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.385136 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.385359 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.385451 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.385679 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.385810 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.386027 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.386114 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.386351 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.386444 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.386654 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.386739 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.386962 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.387055 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.387268 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.387353 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.387575 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.387669 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.387880 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.387964 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.388184 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.388267 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.388490 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.388582 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.388800 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.388885 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.389107 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.389191 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.389437 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.389534 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.389778 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.389877 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.390094 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.390181 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.390403 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.390497 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.390712 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.390797 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.391016 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.391101 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.391327 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.391414 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.391632 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.391723 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.391935 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.392026 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.392243 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.392328 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.392546 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.392631 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.392853 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.392937 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.393155 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.393241 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.393468 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.393582 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.393796 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.393925 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.394118 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.394237 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.394434 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.394541 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.394745 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.394840 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.395075 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.395159 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.395390 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.395473 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.395701 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.395794 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.396018 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.396102 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.396330 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.396414 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.396647 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.396791 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.396958 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.397042 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.397318 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.397401 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.397623 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.397793 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.397957 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.398121 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.398266 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.398435 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.398592 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.398751 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.398898 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.399067 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.399201 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.399390 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.399509 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.399717 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.399830 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.400028 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.400133 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.400449 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.400540 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.400767 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.400851 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.401086 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.401171 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.401404 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.401502 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.401716 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.401869 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.402052 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.402181 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.402368 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.402491 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.402700 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.402816 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.403013 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.403140 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.403323 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.403464 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.403631 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.403767 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.403960 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.404079 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.404270 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.404387 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.404595 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.404708 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.405021 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.405106 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.405351 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.405435 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.405660 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.405750 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.405988 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.406112 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.406311 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.406431 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.406631 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.406748 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.406944 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.407077 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.407264 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.407406 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.407677 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.407762 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.408000 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.408096 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.408308 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.408394 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.408625 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.408711 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.408948 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.409040 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.409250 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.409336 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.409557 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.409649 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.409889 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.409978 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.410196 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.410296 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.410499 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.410585 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.410820 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.410912 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.411121 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.411208 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.411430 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.411561 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.411738 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.411861 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.412050 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.412193 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.412352 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.412510 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.412652 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.412835 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.412972 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.413165 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.413272 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.413558 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.413644 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.413902 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.414002 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.414222 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.414308 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.414534 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.414619 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.414834 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.414957 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.415155 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.415240 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.415461 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.415545 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.415758 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.415843 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.416061 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.416146 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.416362 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.416447 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.416675 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.416760 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.416987 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.417078 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.417301 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.417385 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.417611 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.417696 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.417965 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.418052 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.418274 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.418370 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.418600 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.418685 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.418922 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.419012 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.419228 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.419320 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.419545 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.419629 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.419863 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.419947 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.420161 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.420254 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.420463 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.420548 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.421279 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.421370 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.421578 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.421671 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.421908 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.422009 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.422211 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.422303 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.422519 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.422606 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.422819 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.422905 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.423119 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.423210 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.423419 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.423506 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.423741 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.423843 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.424043 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.424131 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.424362 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.424448 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.424670 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.424763 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.424972 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.425102 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.425276 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.425362 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.425575 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.425660 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.425939 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.426040 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.426244 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.426330 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.426555 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.426639 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.426871 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.426964 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.427183 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.427268 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.427491 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.427582 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.427797 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.427893 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.428117 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.428202 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.428422 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.428505 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.428729 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.428821 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.429094 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.429194 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.429352 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.429445 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.429663 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.429798 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.430008 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.430094 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.430322 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.430407 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.430631 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.430719 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.430946 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.431039 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.431257 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.431342 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.431574 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.431661 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.431938 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.432094 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.432256 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.432433 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.432586 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.432730 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.432909 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.433041 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.433230 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.433352 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.433549 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.433666 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.433893 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.434002 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.434216 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.434313 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.434538 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.434624 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.434857 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.434950 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.435174 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.435270 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.435495 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.435581 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.435814 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.435899 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.436133 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.436224 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.437069 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.437216 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.437388 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.437523 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.437704 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.437868 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.438044 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.438192 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.438358 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.438512 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.438716 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.438835 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.439031 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.439154 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.439337 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.439472 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.439651 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.439789 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.439970 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.440111 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.440282 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.440428 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.440594 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.440762 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.440904 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.441093 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.441217 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.441425 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.441520 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.441781 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.441915 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.442115 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.442213 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.442439 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.442525 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.442748 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.442832 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.443069 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.443165 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.443398 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.443483 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.443717 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.443809 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.444029 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.444115 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.444340 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.444432 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.444656 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.444743 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.445053 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.445173 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.445374 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.445490 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.445692 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.445912 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.446057 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.446243 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.446357 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.446566 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.446678 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.446885 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.446995 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.447201 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.447317 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.447527 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.447641 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.448095 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.448233 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.448401 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.448574 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.448711 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.448900 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.449020 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.449221 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.449307 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.449541 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.449634 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.449960 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.450266 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.450527 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.450622 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.450879 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.451410 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.451760 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.452104 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.452199 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.452428 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.452526 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.452756 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.452862 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.453072 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.453162 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.453378 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.453468 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.453698 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.453831 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.454032 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.454122 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.454337 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.454462 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.454648 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.454782 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.454958 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.455110 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.455262 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.455482 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.455595 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.455779 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.455879 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.456090 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.456176 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.456426 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.456521 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.456735 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.456827 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.457037 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.457123 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.457360 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.457451 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.457662 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.457747 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.457993 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.458228 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.458324 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.458587 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.458674 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.458886 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.458978 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.459190 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.459283 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.459494 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.459579 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.459796 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.459882 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.460114 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.460206 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.460419 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.460508 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.460729 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.460817 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.461036 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.461306 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.461412 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.461495 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.461637 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.461735 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.461971 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.462070 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.462276 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.462370 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.462592 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.462678 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.462894 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.462984 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.463197 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.463284 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.463510 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.463601 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.463818 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.463904 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.464140 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.464226 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.464449 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.464542 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.464758 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.464849 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.465065 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.465156 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.465383 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.465510 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.465695 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.465948 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.466039 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.466330 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.466415 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.466639 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.466725 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.466957 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.467043 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.467266 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.467352 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.467609 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.467714 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.467914 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.468001 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.468218 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.468302 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.468524 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.468611 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.468838 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.468922 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.469144 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.469230 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.469453 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.469539 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.469778 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.469867 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.470096 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.470192 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.470406 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.470490 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.470716 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.470803 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.471025 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.471122 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.471337 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.471424 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.471650 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.471734 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.471986 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.472081 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.472305 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.472399 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.472622 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.472839 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.472932 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.473225 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.473311 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.473533 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.473617 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.473874 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.473984 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.474185 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.474272 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.474493 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.474578 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.474808 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.474902 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.475136 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.475228 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.475445 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.475530 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.475751 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.475840 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.476157 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.476261 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.476465 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.476568 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.476778 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.476879 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.477092 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.477177 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.477398 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.477482 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.477713 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.477842 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.478056 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.478142 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.478373 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.478459 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.478695 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.478782 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.479021 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.479105 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.479349 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.479440 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.479672 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.479765 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.479996 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.480081 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.480316 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.480415 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.480620 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.480719 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.480924 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.481010 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.481228 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.481326 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.481536 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.481621 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.481878 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.481967 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.482212 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.482298 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.482581 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.482718 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.482825 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.482950 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.483139 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.483740 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.483970 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.484064 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.484279 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.484365 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.484600 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.484692 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.484919 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.485013 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.485234 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.485332 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.485543 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.485628 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.485897 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.485988 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.486208 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.486306 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.486517 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.486611 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.486827 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.486922 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.487139 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.487233 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.487447 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.487533 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.487755 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.487841 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.488080 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.488175 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.488402 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.488489 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.488706 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.488799 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.489025 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.489112 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.489337 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.489423 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.489653 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.489739 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.489994 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.490086 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.490304 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.490390 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.490634 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.490720 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.490942 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.491029 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.491256 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.491349 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.491569 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.491738 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.491871 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.491993 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.492184 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.492283 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.492497 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.492596 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.492819 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.492905 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.493143 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.493230 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.493468 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.493562 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.493826 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.493918 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.494136 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.494223 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.494454 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.494542 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.494770 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.494897 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.495101 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.495195 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.495411 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.495496 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.495721 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.495848 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.496025 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.496110 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.496266 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:28:09.496353 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.496669 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.496991 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.497306 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.497642 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.497984 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.498305 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.498622 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.499477 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.499803 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.500126 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.500458 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.500790 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.501123 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.501456 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.501831 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.502152 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.502502 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.502837 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.503158 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.503475 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.503787 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:28:09.504036 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:28:09.519500 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_db.sqlalchemy.engines [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:28:09.527983 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG oslo_db.sqlalchemy.engines [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:28:09.586072 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.context [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca99323b-21e3-4055-ab5d-fe0a9982137e(cell1) {{(pid=101955) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:28:09.590498 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:28:09.592240 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:28:09.593075 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:28:09.595024 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.context [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca99323b-21e3-4055-ab5d-fe0a9982137e(cell1) {{(pid=101956) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:28:09.595120 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:28:09.599443 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG oslo_concurrency.lockutils [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:28:09.601224 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG oslo_concurrency.lockutils [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:28:09.602281 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG oslo_concurrency.lockutils [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:28:09.604255 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG oslo_concurrency.lockutils [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101956) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:28:09.605836 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_db.sqlalchemy.engines [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:28:09.609529 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_db.sqlalchemy.engines [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:28:09.618148 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG oslo_db.sqlalchemy.engines [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:28:09.620381 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG oslo_db.sqlalchemy.engines [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:28:09.775338 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_db.sqlalchemy.engines [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:28:09.786049 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG oslo_db.sqlalchemy.engines [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:28:10.117311 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: WARNING keystonemiddleware.auth_token [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:28:10.118022 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: WARNING keystonemiddleware.auth_token [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:28:10.123871 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: WARNING keystonemiddleware.auth_token [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:28:10.125076 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: WARNING keystonemiddleware.auth_token [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:28:10.464328 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: WARNING keystonemiddleware.auth_token [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:28:10.466575 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: WARNING keystonemiddleware.auth_token [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:28:10.470039 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: WARNING keystonemiddleware.auth_token [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:28:10.472381 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: WARNING keystonemiddleware.auth_token [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:28:10.475111 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d540c3f9c0 pid: 101955 (default app) Dec 15 13:28:10.477203 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:28:10.477415 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d540c3f9c0 pid: 101956 (default app) Dec 15 13:28:10.478420 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-d669a624-e3ac-43ef-a3eb-de31febf6058 None None] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001790 Dec 15 13:28:10.478830 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 788 bytes} [Wed Dec 15 13:28:10 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:34.004503 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:34.007989 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Dec 15 13:29:34.014023 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:34 2021] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:34.502331 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-7acf2a9c-3ce4-4160-af13-f35c40e04599 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:34.532804 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-7acf2a9c-3ce4-4160-af13-f35c40e04599 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.518339 Dec 15 13:29:34.533721 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 2/3] 10.222.0.83 () {60 vars in 1291 bytes} [Wed Dec 15 13:29:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:29:37.140369 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:37.142141 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-b999abd4-e6ab-4ea1-9a0d-e32f0bd0f0de None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003384 Dec 15 13:29:37.143056 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 2/4] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:37 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:37.213442 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-1b663c4d-56f4-45ee-a773-7cae31c9c478 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:37.232583 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:29:37.232583 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: warnings.warn(msg) Dec 15 13:29:37.267256 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-1b663c4d-56f4-45ee-a773-7cae31c9c478 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116130 Dec 15 13:29:37.268259 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 3/5] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:29:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:29:37.526169 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-62f31f3d-ad69-477e-a939-5cf29111b98f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:37.530041 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:29:37.530041 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: warnings.warn(msg) Dec 15 13:29:37.585487 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-62f31f3d-ad69-477e-a939-5cf29111b98f admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.308738 Dec 15 13:29:37.586099 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 3/6] 10.222.0.83 () {64 vars in 1335 bytes} [Wed Dec 15 13:29:37 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:29:40.487432 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-1b663c4d-56f4-45ee-a773-7cae31c9c478 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:40.489333 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-1b663c4d-56f4-45ee-a773-7cae31c9c478 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002362 Dec 15 13:29:40.490638 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 4/7] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:40 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:40.612432 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-f1ce77ad-abbc-4e74-b0a5-c41fce640013 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 5, "id": "d1", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:40.631078 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:29:40.631078 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: warnings.warn(msg) Dec 15 13:29:40.656875 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-f1ce77ad-abbc-4e74-b0a5-c41fce640013 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156273 Dec 15 13:29:40.657591 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 4/8] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:29:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:29:40.670780 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-34d99e5c-d428-445b-a9a3-645603ce4cdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:40.672351 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:29:40.672351 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: warnings.warn(msg) Dec 15 13:29:40.708618 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-34d99e5c-d428-445b-a9a3-645603ce4cdd admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041489 Dec 15 13:29:40.709373 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 5/9] 10.222.0.83 () {64 vars in 1335 bytes} [Wed Dec 15 13:29:40 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:29:43.296006 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-f1ce77ad-abbc-4e74-b0a5-c41fce640013 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:43.297216 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-f1ce77ad-abbc-4e74-b0a5-c41fce640013 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Dec 15 13:29:43.301473 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:43 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:43.369538 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-905b7ded-a422-48f0-ac00-a480a4ce3e08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:43.393617 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-905b7ded-a422-48f0-ac00-a480a4ce3e08 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088463 Dec 15 13:29:43.395080 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 6/11] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:29:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:29:43.407120 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-e13a878f-8fa8-475e-aaa2-d7f3ffa03f0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:43.433157 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-e13a878f-8fa8-475e-aaa2-d7f3ffa03f0b admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029790 Dec 15 13:29:43.434056 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 6/12] 10.222.0.83 () {64 vars in 1335 bytes} [Wed Dec 15 13:29:43 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:29:45.929278 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-905b7ded-a422-48f0-ac00-a480a4ce3e08 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:45.930295 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-905b7ded-a422-48f0-ac00-a480a4ce3e08 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Dec 15 13:29:45.930699 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 7/13] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:45.991169 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-a9a38b1e-b184-4368-9801-fbfeda830ac2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:46.009796 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-a9a38b1e-b184-4368-9801-fbfeda830ac2 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072702 Dec 15 13:29:46.010362 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 7/14] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:29:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:29:46.022986 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-cf17a053-5924-44b4-aad5-457975313c31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:46.050241 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-cf17a053-5924-44b4-aad5-457975313c31 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031466 Dec 15 13:29:46.050817 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 8/15] 10.222.0.83 () {64 vars in 1335 bytes} [Wed Dec 15 13:29:46 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:29:48.630226 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-a9a38b1e-b184-4368-9801-fbfeda830ac2 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:48.631859 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-a9a38b1e-b184-4368-9801-fbfeda830ac2 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 Dec 15 13:29:48.634083 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 8/16] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:48 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:29:48.700145 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-739ee9b9-205a-4b2a-8905-a4977c8cca86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:48.719111 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-739ee9b9-205a-4b2a-8905-a4977c8cca86 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079691 Dec 15 13:29:48.721834 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 9/17] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:29:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:29:48.732219 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-8c84a6d7-9a4e-48aa-91a1-10d02ea73272 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:48.757862 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-8c84a6d7-9a4e-48aa-91a1-10d02ea73272 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029496 Dec 15 13:29:48.758689 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 9/18] 10.222.0.83 () {64 vars in 1335 bytes} [Wed Dec 15 13:29:48 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:29:51.202972 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-739ee9b9-205a-4b2a-8905-a4977c8cca86 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:51.203987 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-739ee9b9-205a-4b2a-8905-a4977c8cca86 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 15 13:29:51.204403 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 10/19] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:51.272262 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-b3b2ac25-1809-4074-9205-f75b2e24c5b0 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:51.295612 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-b3b2ac25-1809-4074-9205-f75b2e24c5b0 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084142 Dec 15 13:29:51.296177 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 10/20] 10.222.0.83 () {60 vars in 1291 bytes} [Wed Dec 15 13:29:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:29:53.969374 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-739ee9b9-205a-4b2a-8905-a4977c8cca86 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:53.970597 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-739ee9b9-205a-4b2a-8905-a4977c8cca86 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 15 13:29:53.971077 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 11/21] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:54.041192 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-82dce0f3-c5e2-4de8-98a0-b4b4d604ed33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "id": "1", "vcpus": 1}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:54.063417 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-82dce0f3-c5e2-4de8-98a0-b4b4d604ed33 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079219 Dec 15 13:29:54.064001 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 11/22] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:29:53 2021] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:29:54.076506 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-635ad7fb-bcbd-4636-bee3-287d7eb94592 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:54.100873 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-635ad7fb-bcbd-4636-bee3-287d7eb94592 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028056 Dec 15 13:29:54.101470 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 12/23] 10.222.0.83 () {64 vars in 1332 bytes} [Wed Dec 15 13:29:54 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:29:56.497010 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-82dce0f3-c5e2-4de8-98a0-b4b4d604ed33 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:56.498089 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-82dce0f3-c5e2-4de8-98a0-b4b4d604ed33 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 Dec 15 13:29:56.498497 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 12/24] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:56.564513 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-6f8393ae-e20a-45b4-bda2-6baa2bf62992 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:56.584264 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-6f8393ae-e20a-45b4-bda2-6baa2bf62992 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077349 Dec 15 13:29:56.584834 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 13/25] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:29:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:29:56.597332 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-66581a36-ed79-4d92-bd64-06cb9c261d0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:56.620354 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-66581a36-ed79-4d92-bd64-06cb9c261d0a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026887 Dec 15 13:29:56.621571 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 13/26] 10.222.0.83 () {64 vars in 1332 bytes} [Wed Dec 15 13:29:56 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:29:59.022692 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-6f8393ae-e20a-45b4-bda2-6baa2bf62992 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:29:59.023690 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-6f8393ae-e20a-45b4-bda2-6baa2bf62992 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 15 13:29:59.024094 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 14/27] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:29:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:29:59.086665 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-f3e5aa6d-0603-4706-9dd6-f6b2a8d0441e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:59.104717 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-f3e5aa6d-0603-4706-9dd6-f6b2a8d0441e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073674 Dec 15 13:29:59.105375 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 14/28] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:29:59 2021] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:29:59.117357 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-fbe011fc-9dbc-4cd4-aaf8-a77d223a66be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:29:59.149727 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-fbe011fc-9dbc-4cd4-aaf8-a77d223a66be admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035884 Dec 15 13:29:59.150553 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 15/29] 10.222.0.83 () {64 vars in 1332 bytes} [Wed Dec 15 13:29:59 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:30:01.596475 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-f3e5aa6d-0603-4706-9dd6-f6b2a8d0441e admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:01.597433 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-f3e5aa6d-0603-4706-9dd6-f6b2a8d0441e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Dec 15 13:30:01.598413 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 15/30] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:30:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:01.663929 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-5094f59b-b6d2-4626-9914-94f3931132fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "ram": 8192}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:01.684401 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-5094f59b-b6d2-4626-9914-94f3931132fd admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079036 Dec 15 13:30:01.685745 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 16/31] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:30:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:30:01.697862 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-974cc4ac-f0ae-4e5b-8ad2-eb150cc4f926 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:01.728524 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-974cc4ac-f0ae-4e5b-8ad2-eb150cc4f926 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034305 Dec 15 13:30:01.729102 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 16/32] 10.222.0.83 () {64 vars in 1332 bytes} [Wed Dec 15 13:30:01 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:30:04.296792 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-5094f59b-b6d2-4626-9914-94f3931132fd admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:04.297799 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-5094f59b-b6d2-4626-9914-94f3931132fd admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Dec 15 13:30:04.300743 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 17/33] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:30:04 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:04.360468 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-6cf518cf-4325-4ae5-bb04-c070be5920a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:04.387044 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-6cf518cf-4325-4ae5-bb04-c070be5920a8 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081912 Dec 15 13:30:04.388922 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 17/34] 10.222.0.83 () {64 vars in 1282 bytes} [Wed Dec 15 13:30:04 2021] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:30:04.401667 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-c1ec5dde-0cd9-4daf-b007-f38b614b33b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:04.433334 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-c1ec5dde-0cd9-4daf-b007-f38b614b33b4 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035100 Dec 15 13:30:04.442790 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 18/35] 10.222.0.83 () {64 vars in 1332 bytes} [Wed Dec 15 13:30:04 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:30:25.819334 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-6cf518cf-4325-4ae5-bb04-c070be5920a8 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:25.820330 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-6cf518cf-4325-4ae5-bb04-c070be5920a8 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Dec 15 13:30:25.820729 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 18/36] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:30:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:25.878742 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-396984de-168b-451a-8d8f-dc96afc8574a admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:25.895104 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-396984de-168b-451a-8d8f-dc96afc8574a admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067463 Dec 15 13:30:25.895636 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 19/37] 10.222.0.83 () {60 vars in 1291 bytes} [Wed Dec 15 13:30:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:30:27.498335 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-6cf518cf-4325-4ae5-bb04-c070be5920a8 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:27.499876 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-6cf518cf-4325-4ae5-bb04-c070be5920a8 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Dec 15 13:30:27.500282 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 19/38] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:30:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:30:27.695557 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-e9130b9d-acf5-4ad7-acb5-35ef0e4bd237 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:27.701007 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.wsgi [None req-e9130b9d-acf5-4ad7-acb5-35ef0e4bd237 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 13:30:27.701604 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-e9130b9d-acf5-4ad7-acb5-35ef0e4bd237 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:30:27.702692 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-e9130b9d-acf5-4ad7-acb5-35ef0e4bd237 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061793 Dec 15 13:30:27.703206 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 20/39] 10.222.0.83 () {60 vars in 1190 bytes} [Wed Dec 15 13:30:27 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:27.713139 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-fbcd2654-5bdb-4af9-9515-e63d44a25da3 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:27.734246 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-fbcd2654-5bdb-4af9-9515-e63d44a25da3 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024642 Dec 15 13:30:27.734826 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 20/40] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Dec 15 13:30:27 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:30:27.745091 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-9e2dbe1e-3335-4cd9-a71f-ba22cf8f7380 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:27.766474 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-9e2dbe1e-3335-4cd9-a71f-ba22cf8f7380 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024864 Dec 15 13:30:27.767184 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 21/41] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Dec 15 13:30:27 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:30:27.777217 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-5dfd728f-8e31-48f3-9ec5-33dfb3d82a55 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:27.783367 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.wsgi [None req-5dfd728f-8e31-48f3-9ec5-33dfb3d82a55 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 13:30:27.783931 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-5dfd728f-8e31-48f3-9ec5-33dfb3d82a55 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:30:27.784734 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-5dfd728f-8e31-48f3-9ec5-33dfb3d82a55 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011168 Dec 15 13:30:27.785250 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 21/42] 10.222.0.83 () {60 vars in 1190 bytes} [Wed Dec 15 13:30:27 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:29.268264 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-9e2dbe1e-3335-4cd9-a71f-ba22cf8f7380 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:29.269252 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-9e2dbe1e-3335-4cd9-a71f-ba22cf8f7380 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Dec 15 13:30:29.269644 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 22/43] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:30:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:29.470933 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-013915d9-88c5-4cdb-80bb-157029b4ba0c admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:29.476745 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.wsgi [None req-013915d9-88c5-4cdb-80bb-157029b4ba0c admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 13:30:29.477241 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-013915d9-88c5-4cdb-80bb-157029b4ba0c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:30:29.478064 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-013915d9-88c5-4cdb-80bb-157029b4ba0c admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072443 Dec 15 13:30:29.478589 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 22/44] 10.222.0.83 () {60 vars in 1190 bytes} [Wed Dec 15 13:30:29 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:29.488261 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-93854ddf-1767-4577-90fb-b21fb86ffe8f admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:29.502145 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-93854ddf-1767-4577-90fb-b21fb86ffe8f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017326 Dec 15 13:30:29.502680 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 23/45] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Dec 15 13:30:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:30:29.512608 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-5b5b3dca-ccc4-409a-96b1-77679304db7f admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:29.526993 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-5b5b3dca-ccc4-409a-96b1-77679304db7f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017790 Dec 15 13:30:29.527554 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 23/46] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Dec 15 13:30:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:30:29.537533 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-01905099-f351-4fec-bc3f-4f9e4d3b2619 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:29.542807 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.wsgi [None req-01905099-f351-4fec-bc3f-4f9e4d3b2619 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 13:30:29.543366 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-01905099-f351-4fec-bc3f-4f9e4d3b2619 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:30:29.544140 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-01905099-f351-4fec-bc3f-4f9e4d3b2619 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010134 Dec 15 13:30:29.544630 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 24/47] 10.222.0.83 () {60 vars in 1190 bytes} [Wed Dec 15 13:30:29 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:31.046233 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-5b5b3dca-ccc4-409a-96b1-77679304db7f admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:31.047412 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-5b5b3dca-ccc4-409a-96b1-77679304db7f admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Dec 15 13:30:31.048012 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 24/48] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:30:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:31.254222 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-3fab310b-d654-4700-991e-57044d3c3248 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:31.259838 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.wsgi [None req-3fab310b-d654-4700-991e-57044d3c3248 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 13:30:31.261248 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-3fab310b-d654-4700-991e-57044d3c3248 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101955) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:30:31.262106 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-3fab310b-d654-4700-991e-57044d3c3248 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.071364 Dec 15 13:30:31.262648 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 25/49] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Dec 15 13:30:31 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:31.273652 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-29a41132-73b5-4a60-96ae-3b64b487ed6a admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:31.290365 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-29a41132-73b5-4a60-96ae-3b64b487ed6a admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020779 Dec 15 13:30:31.290936 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 25/50] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Dec 15 13:30:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:30:31.303198 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:31.318661 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020681 Dec 15 13:30:31.319325 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 26/51] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Dec 15 13:30:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:30:31.330755 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-79853365-c6ae-4d39-8b31-8a177664fa10 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:31.336363 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.wsgi [None req-79853365-c6ae-4d39-8b31-8a177664fa10 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 13:30:31.337624 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-79853365-c6ae-4d39-8b31-8a177664fa10 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101956) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:30:31.338199 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-79853365-c6ae-4d39-8b31-8a177664fa10 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011998 Dec 15 13:30:31.338712 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 26/52] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Dec 15 13:30:31 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 13:30:32.856493 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:32.857496 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Dec 15 13:30:32.857990 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 27/53] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:30:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:33.053390 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-e21d9c60-1203-4b06-b726-bc0f82d11d2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:33.075454 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-e21d9c60-1203-4b06-b726-bc0f82d11d2c admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.078428 Dec 15 13:30:33.076021 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 27/54] 10.222.0.83 () {64 vars in 1235 bytes} [Wed Dec 15 13:30:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:30:34.601417 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:34.602466 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 15 13:30:34.602858 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 28/55] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:30:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:34.803301 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-71430680-52cd-4c39-8d27-24eb398e4d0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:34.826535 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-71430680-52cd-4c39-8d27-24eb398e4d0c admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.083237 Dec 15 13:30:34.837833 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 28/56] 10.222.0.83 () {64 vars in 1235 bytes} [Wed Dec 15 13:30:34 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:30:36.372835 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:36.374768 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003027 Dec 15 13:30:36.375175 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 29/57] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:30:36 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:36.571085 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-f4a8b6fb-2da9-4c16-a633-f10ae7950df7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:36.591231 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-f4a8b6fb-2da9-4c16-a633-f10ae7950df7 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075454 Dec 15 13:30:36.591976 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 29/58] 10.222.0.83 () {64 vars in 1235 bytes} [Wed Dec 15 13:30:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:30:38.196531 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:38.197526 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Dec 15 13:30:38.197948 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 30/59] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:30:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:38.390394 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-82064dbd-060c-4946-8608-3b2d3953f4a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:30:38.408471 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-82064dbd-060c-4946-8608-3b2d3953f4a9 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070817 Dec 15 13:30:38.408884 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 30/60] 10.222.0.83 () {64 vars in 1235 bytes} [Wed Dec 15 13:30:38 2021] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:30:39.921806 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:39.922815 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Dec 15 13:30:39.923203 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 31/61] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:30:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:30:40.128000 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-4a8b0401-8cec-4f74-9e28-e06e0ea9b305 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:30:40.147638 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-4a8b0401-8cec-4f74-9e28-e06e0ea9b305 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083603 Dec 15 13:30:40.148208 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 31/62] 10.222.0.83 () {60 vars in 1202 bytes} [Wed Dec 15 13:30:40 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:28.169461 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.170494 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-b7b7cc31-d0f3-4a96-a110-ec2186e70d81 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Dec 15 13:31:28.170897 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 32/63] 10.222.0.83 () {54 vars in 930 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:31:28.231076 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-c14b1845-9622-4101-9b38-e84fb4fd0494 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.253156 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-c14b1845-9622-4101-9b38-e84fb4fd0494 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075706 Dec 15 13:31:28.253698 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 32/64] 10.222.0.83 () {60 vars in 1291 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:31:28.277997 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-8532a556-b108-4885-af63-706221cfc0d5 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.285882 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-8532a556-b108-4885-af63-706221cfc0d5 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012088 Dec 15 13:31:28.286430 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 33/65] 10.222.0.83 () {60 vars in 1282 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:31:28.299534 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-05cf66dd-99f8-42ad-8e0b-989aa6cd132d admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.307427 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-05cf66dd-99f8-42ad-8e0b-989aa6cd132d admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011450 Dec 15 13:31:28.307971 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 33/66] 10.222.0.83 () {60 vars in 1285 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:28.320032 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-d7c9737b-f8c0-447b-a771-1d83e5a32ee9 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.328556 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-d7c9737b-f8c0-447b-a771-1d83e5a32ee9 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012069 Dec 15 13:31:28.329089 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 34/67] 10.222.0.83 () {60 vars in 1285 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:31:28.341694 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:31:28.349507 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011345 Dec 15 13:31:28.350077 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 34/68] 10.222.0.83 () {60 vars in 1282 bytes} [Wed Dec 15 13:31:28 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:32:57.976509 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-54e21b2b-1342-466b-b21d-aa685f2bfbe6 tempest-verify_tempest_config-2093758036 tempest-verify_tempest_config-2093758036-project] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:32:57.978497 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-54e21b2b-1342-466b-b21d-aa685f2bfbe6 tempest-verify_tempest_config-2093758036 tempest-verify_tempest_config-2093758036-project] 10.222.0.83 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111706 Dec 15 13:32:57.979041 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 35/69] 10.222.0.83 () {58 vars in 1133 bytes} [Wed Dec 15 13:32:57 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:29.348581 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:29.349583 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Dec 15 13:34:29.350023 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 35/70] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:34:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:29.622750 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-d85d05be-6b69-45d7-b1e0-463db2e5859c admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:29.623619 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:29.623619 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: warnings.warn(msg) Dec 15 13:34:29.625497 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-d85d05be-6b69-45d7-b1e0-463db2e5859c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.625988 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-d85d05be-6b69-45d7-b1e0-463db2e5859c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.626859 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-d85d05be-6b69-45d7-b1e0-463db2e5859c admin admin] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:29.627497 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-d85d05be-6b69-45d7-b1e0-463db2e5859c admin admin] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:29.673131 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-d85d05be-6b69-45d7-b1e0-463db2e5859c admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.179367 Dec 15 13:34:29.673714 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 36/71] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Dec 15 13:34:29 2021] GET /compute/v2.1/os-services => generated 791 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:31.227109 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:31.228266 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Dec 15 13:34:31.228664 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 36/72] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:34:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:31.431310 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-4afe0431-c4fa-4b3a-b6bf-f2be99a8103a admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:31.432414 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:31.432414 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: warnings.warn(msg) Dec 15 13:34:31.433990 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-4afe0431-c4fa-4b3a-b6bf-f2be99a8103a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.434437 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-4afe0431-c4fa-4b3a-b6bf-f2be99a8103a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.435241 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-4afe0431-c4fa-4b3a-b6bf-f2be99a8103a admin admin] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:31.435673 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-4afe0431-c4fa-4b3a-b6bf-f2be99a8103a admin admin] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:31.454832 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-4afe0431-c4fa-4b3a-b6bf-f2be99a8103a admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079591 Dec 15 13:34:31.455907 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 37/73] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Dec 15 13:34:31 2021] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:34:43.402249 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:43.403240 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Dec 15 13:34:43.403816 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 37/74] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:34:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:43.601307 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-ace44d58-3bb4-4dc7-afc0-2e633a6d1412 admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:43.602638 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:43.602638 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: warnings.warn(msg) Dec 15 13:34:43.604195 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-ace44d58-3bb4-4dc7-afc0-2e633a6d1412 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.604634 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-ace44d58-3bb4-4dc7-afc0-2e633a6d1412 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.605474 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-ace44d58-3bb4-4dc7-afc0-2e633a6d1412 admin admin] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:43.606059 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-ace44d58-3bb4-4dc7-afc0-2e633a6d1412 admin admin] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:43.632789 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-ace44d58-3bb4-4dc7-afc0-2e633a6d1412 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086154 Dec 15 13:34:43.633454 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 38/75] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Dec 15 13:34:43 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:34:45.156767 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: DEBUG nova.api.openstack.wsgi [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] Calling method '>' {{(pid=101956) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:45.157773 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: INFO nova.api.openstack.requestlog [None req-ad120c2c-86b0-48db-8b9d-9c0f4b8a4675 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Dec 15 13:34:45.158217 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: [pid: 101956|app: 0|req: 38/76] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Dec 15 13:34:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:34:45.349699 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG nova.api.openstack.wsgi [None req-c8126e79-4857-4ad8-9232-380c8c1f04cf admin admin] Calling method '>' {{(pid=101955) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:34:45.350969 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:34:45.350969 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: warnings.warn(msg) Dec 15 13:34:45.352525 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-c8126e79-4857-4ad8-9232-380c8c1f04cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.352968 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-c8126e79-4857-4ad8-9232-380c8c1f04cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.353779 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-c8126e79-4857-4ad8-9232-380c8c1f04cf admin admin] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:34:45.354203 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: DEBUG oslo_concurrency.lockutils [None req-c8126e79-4857-4ad8-9232-380c8c1f04cf admin admin] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101955) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:34:45.375628 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: INFO nova.api.openstack.requestlog [None req-c8126e79-4857-4ad8-9232-380c8c1f04cf admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077114 Dec 15 13:34:45.376100 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: [pid: 101955|app: 0|req: 39/77] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Dec 15 13:34:45 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:35:43.291866 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: Wed Dec 15 13:35:43 2021 - graceful shutdown triggered... Dec 15 13:35:43.290899 dv-cinder-813228-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 13:35:43.292915 dv-cinder-813228-4-iscsi devstack@n-api.service[101955]: Gracefully killing worker 1 (pid: 101955)... Dec 15 13:35:43.293276 dv-cinder-813228-4-iscsi devstack@n-api.service[101956]: Gracefully killing worker 2 (pid: 101956)... Dec 15 13:35:44.291996 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: worker 1 buried after 1 seconds Dec 15 13:35:44.292560 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: worker 2 buried after 1 seconds Dec 15 13:35:44.292560 dv-cinder-813228-4-iscsi devstack@n-api.service[101954]: goodbye to uWSGI. Dec 15 13:35:44.294143 dv-cinder-813228-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 13:35:44.294744 dv-cinder-813228-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 13:35:44.297622 dv-cinder-813228-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 13:35:44.312333 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 13:35:44 2021] *** Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: nodename: dv-cinder-813228-4-iscsi Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: machine: x86_64 Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: clock source: unix Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: pcre jit disabled Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: detected number of CPU cores: 4 Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: current working directory: / Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: detected binary path: /usr/bin/uwsgi-core Dec 15 13:35:44.315059 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: your processes number limit is 47680 Dec 15 13:35:44.315925 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: your memory page size is 4096 bytes Dec 15 13:35:44.315925 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: detected max file descriptor number: 2048 Dec 15 13:35:44.315925 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: lock engine: pthread robust mutexes Dec 15 13:35:44.315925 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: thunder lock: enabled Dec 15 13:35:44.315925 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 13:35:44.315925 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 13:35:44.366115 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: Python main interpreter initialized at 0x55c756c9f9c0 Dec 15 13:35:44.366115 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: python threads support enabled Dec 15 13:35:44.366115 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: your server socket listen backlog is limited to 100 connections Dec 15 13:35:44.366115 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: your mercy for graceful operations on workers is 90 seconds Dec 15 13:35:44.366552 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 13:35:44.366552 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: *** Operational MODE: preforking *** Dec 15 13:35:44.366886 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: *** uWSGI is running in multiple interpreter mode *** Dec 15 13:35:44.366886 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: spawned uWSGI master process (pid: 122598) Dec 15 13:35:44.367090 dv-cinder-813228-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 13:35:44.367692 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: spawned uWSGI worker 1 (pid: 122611, cores: 1) Dec 15 13:35:44.368053 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: spawned uWSGI worker 2 (pid: 122612, cores: 1) Dec 15 13:35:44.370013 dv-cinder-813228-4-iscsi devstack@n-api.service[122598]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 13:35:46.268801 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:35:46.268801 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: from cryptography.utils import int_from_bytes Dec 15 13:35:46.269537 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:35:46.269537 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: from cryptography.utils import int_from_bytes Dec 15 13:35:46.282461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:35:46.282461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: from cryptography.utils import int_from_bytes Dec 15 13:35:46.283096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 13:35:46.283096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: from cryptography.utils import int_from_bytes Dec 15 13:35:48.683084 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:35:48.683650 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:35:48.683887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:35:48.684200 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:35:48.684459 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:35:48.684846 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.685175 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.685510 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.685843 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.687023 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.687348 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.687681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.688010 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.688349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.688618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.688935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.689263 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813228-4-iscsi {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.689589 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.689922 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.690257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.690569 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.690878 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.691200 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.691509 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.692010 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.693310 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.693310 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.693515 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.693802 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.694126 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.694438 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.694763 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.695151 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.695982 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.696563 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.696950 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813228-4-iscsi {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.697455 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.697970 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.698440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.699030 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.699516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.699825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.700152 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.700490 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.700964 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.701445 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.701792 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.702124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.702454 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.702762 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.703074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.703388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.703713 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.704024 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.704331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.704584 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.704896 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.705222 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.705544 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.705894 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.706151 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.706404 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.706726 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.707047 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.707359 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.707671 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.707978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.708288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.708596 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.708905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.709216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.709526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.709866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.710185 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.710515 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.710852 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.711173 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.711572 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.711825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.712135 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.712482 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.712801 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.713110 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.713430 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.713771 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.714082 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.714390 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.714700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.715020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.715356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.715663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.715915 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.716216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.716523 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.716841 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.717150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.717554 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.718173 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.718173 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.718472 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.718684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.718990 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.719298 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.719607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.719912 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.720219 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.720526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.720833 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.721154 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.721487 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.721799 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.722111 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.722422 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.722737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.723050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.723357 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.723666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.723990 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.724299 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.724607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.724923 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.725232 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.725540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.725885 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.726218 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.726527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.726844 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.727168 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.727478 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.727783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.728091 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.728435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.728711 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.729019 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.729320 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.729877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.730205 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.730532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.730845 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.731158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.731464 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.731785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.732127 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.732469 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.732814 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.733131 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.733237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 13:35:48.733645 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 13:35:48.733725 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.733832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.734013 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 13:35:48.734124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.734329 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 13:35:48.734436 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.734592 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 13:35:48.734743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.734977 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.735178 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.735356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.735513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.735668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.735827 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.735971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.736067 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.736249 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.736343 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.736597 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.736712 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.736884 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.736997 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.737209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.737301 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.737547 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.737658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.737840 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.737957 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.738167 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.738307 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.738526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.738879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813228-4-iscsi {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.738991 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.739161 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.739243 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.739524 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.739638 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.739724 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.739818 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.740044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.740221 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.740376 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.740526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.740675 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.740845 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.740993 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.741138 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.741356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.741508 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.741671 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.742372 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.742517 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.742668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.742836 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.742983 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.743176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.743376 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.743493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.743699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.743790 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.744018 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.744118 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.744348 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.744448 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.744663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.744779 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.745039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.745150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.745294 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.745386 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.745622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.745720 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813228-4-iscsi {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.745963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.746070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.746271 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.746371 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.746593 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.746693 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.746922 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.747047 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.747231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.747364 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.747566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.747672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.747875 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.747989 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.748192 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.748331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.748509 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.748652 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.748818 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.748987 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.749136 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.749310 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.749450 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.749634 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.749785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.749984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.750119 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.750294 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.750461 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.750608 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.750758 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.750896 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.751038 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.751215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.751377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.751525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.751674 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.751817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.751966 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.752114 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.752267 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.752416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.752563 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.752717 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.752858 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.753006 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.753153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.753300 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.753440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.753589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.753737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.753909 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.754066 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.754167 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.754398 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.754498 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.754707 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.754808 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.755022 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.755130 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.755335 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.755449 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.755649 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.755742 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.755956 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.756067 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.756263 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.756362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.756616 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.756719 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.756877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.756977 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.757184 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.757276 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.757549 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.758202 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.758364 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.758487 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.758679 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.758785 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.758985 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.759068 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.759293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.759379 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.759601 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.759696 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.759920 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.760008 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.760235 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.760314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.760544 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.760834 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.760920 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.760998 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.761846 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.761952 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.761952 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.762094 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.762094 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.762230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.762307 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.762488 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.762577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.762823 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.762926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.763140 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.763237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.763463 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.763563 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.763776 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.763882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.764064 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.764155 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.764370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.764459 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.764685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.764808 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.765000 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.765090 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.765305 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.765407 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.765616 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.765715 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.765954 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.766049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.766261 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.766378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.766575 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.767746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.767853 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.767947 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.768032 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.768127 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.768212 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.768302 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.768386 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.768475 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.768565 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.768665 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.768818 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.768910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.768992 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.769083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.769167 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.769258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.769356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.769512 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.769631 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.769900 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.770049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.770201 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.770323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.770520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.770759 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.770867 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.771137 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.771236 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.771331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.771495 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.771658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.771761 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.771849 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.772037 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.772137 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.772410 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.772587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.772733 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.772902 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.773077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.773240 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.773412 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.773559 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.773702 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.773905 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.774026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.774264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.774427 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.774564 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.774709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.774857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.774979 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.775103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.775296 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.775402 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.775622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.775735 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.775932 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.776031 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.776244 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.776339 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.776558 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.776646 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.776869 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.776976 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.777177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.777266 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.777481 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.777576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.777836 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.777951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.778119 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.778214 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.778432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.778527 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.778739 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.778837 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.779048 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.779145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.779356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.779446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.779660 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.779757 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 13:35:48.779967 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.780057 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.780281 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.780377 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.780604 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.780694 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.780917 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.781009 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.781240 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.781330 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.781562 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.781652 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.781891 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.781982 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.782197 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.782349 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.782569 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.782668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.782827 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.782998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.783171 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.783315 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.783511 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.783624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.783773 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.784001 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.784119 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.784253 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.784432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.784578 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.784737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.784911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.785056 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.785235 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.785379 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.785559 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.785696 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.785962 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.786124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.786262 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.786402 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.786543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.786694 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.786860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.787006 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.787186 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.787327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.787502 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.787636 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.787843 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.787999 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.788145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.788279 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.788457 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.788593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.788796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.788945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.789122 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.789272 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.789420 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.789555 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.789737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.789891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.790072 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.790163 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.790378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.790475 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.790691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.790781 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.791011 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.791106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.791391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.791597 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.791771 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.791929 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.792033 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.792246 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.792335 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.792572 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.792760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.792894 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.793076 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.793206 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.793389 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.793587 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.793726 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.793895 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.794022 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.794229 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.794355 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.794516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.794759 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.794883 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.795120 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.795423 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.795738 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.796047 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.796348 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.796652 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.796964 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.797911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.797995 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798152 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798230 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798469 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798549 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798764 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.798861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.799100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.799212 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.799501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.799612 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.799722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.799823 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.800036 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.800140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.800349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.800454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.800651 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.800756 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.800958 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.801143 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.801308 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.801403 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.801612 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.801740 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.801950 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.802090 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.802276 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.802579 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.802771 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.802912 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.803060 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.803208 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.803347 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.803498 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.803645 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.803791 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.803935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.804070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.804155 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.804814 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.804923 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.805168 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.805269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.805484 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.805577 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.805878 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.805980 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.806193 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.806296 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.806504 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.806795 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.806892 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.806967 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.807138 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.807239 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.807442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.807541 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.807752 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.807843 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.808055 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.808145 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.808370 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.808547 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.808681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.808780 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.808987 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.809264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.809363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.809460 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.809631 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.809724 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.809928 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.810017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.810278 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.810394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.810601 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.810709 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.810898 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.810999 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.811228 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.811339 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.811579 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.811679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.811886 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.812078 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.812241 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.812394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.812569 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.812721 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.812866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.813017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.813212 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.813356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.813496 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.813638 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.813822 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.813978 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.814094 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.814307 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.814417 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.814624 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.814730 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.814928 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.815028 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.815232 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.815332 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.815545 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.815634 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.815868 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.815967 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.816182 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.816333 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.816486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.816585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.816797 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.816895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.817104 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.817193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.817409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.817497 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.817716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.817867 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.818051 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.818177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.818358 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.818461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.818664 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.818762 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.818969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.819065 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.819274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.819363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.819577 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.819666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.819899 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.820545 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.820795 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.820907 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.821054 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.821440 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.821623 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.821807 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.821955 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.822126 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.822299 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.822388 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.822603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.822699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.822962 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.823063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.823268 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.823372 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.823588 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.823678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.823911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.824010 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.824223 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.824328 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.824539 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.824640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.824849 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.824968 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.825153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.825294 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.825468 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.825629 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.825797 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.826004 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.826115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.826323 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.826411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.826643 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.826752 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.826974 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.827069 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.827292 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.827384 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.827609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.827707 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.827927 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.828015 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.828238 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.828327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.828548 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.828637 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.828889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.828987 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.829157 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.829258 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.829469 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.829560 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.829794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.829937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.830109 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.830196 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.830419 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.830514 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.830731 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.830819 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.831042 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.831130 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.831352 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.831441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.831664 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.831755 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.831975 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.832071 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.832283 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.832391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.832597 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.832706 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.832907 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.833006 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.833213 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.833337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.833518 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.833617 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.833865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.833971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.834170 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.834390 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.834495 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.834647 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.835400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.835573 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.835748 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.835901 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.835901 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.836314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.836314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.836607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.836607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.837028 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.837172 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.837320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.837476 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.837627 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.837796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.837961 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.838103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.838103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.838384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.838526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.838665 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.838814 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.839044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.839386 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.839713 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.840042 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.840144 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.840356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.840483 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.840678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.840782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.840998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.841150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.841319 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.841408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.841650 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.841740 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.842727 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.842890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.843004 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.843113 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.843239 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.843351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.843499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.843625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.843782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.843782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.844025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.844120 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.844210 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.844291 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.844631 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.845025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.845126 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.845336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.845453 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.845778 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.845885 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.846097 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.846195 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.846418 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.846514 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.846745 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.846834 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.847074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.847171 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.847403 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.847498 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.847712 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.847809 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.848032 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.848127 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.848348 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.848442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.848661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.848761 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.848976 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.849103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.849291 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.849389 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.849605 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.849705 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.849942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.850198 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.850317 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.850530 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.850620 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.850855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.850944 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.851168 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.851375 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.851564 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.851745 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.851932 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.852077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.852219 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.852457 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.852597 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.852696 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.852785 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.852911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.853062 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.853243 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.853364 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.853555 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.853713 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.853885 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.854037 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.854192 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.854285 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.854493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.854589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.854801 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.854927 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.855125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.855213 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.855433 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.855551 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.855747 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.855886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.856062 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.856232 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.856373 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.856543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.856679 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.856852 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.856969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.857181 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.857293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.857490 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.857583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.857826 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.857933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.858137 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.858228 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.858452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.858556 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.858766 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.858857 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.859079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.859170 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.859393 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.859531 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.859709 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.859788 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.860027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.860149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.860345 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.860682 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.860682 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.861090 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.861434 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.861738 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.862132 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.862335 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.862528 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.862710 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.862898 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.862997 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.863274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.863382 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.863476 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.863560 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.863650 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.863761 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.863858 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.863966 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.864061 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.864161 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.864259 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.864341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.864649 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.864756 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.864843 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.864926 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865218 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865291 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865512 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865804 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865893 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.865964 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.866068 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.866240 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.866562 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.867400 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.867708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.867805 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.868036 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.868134 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.868343 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.868454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.868665 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.868762 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.868983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.869134 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.869281 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.869434 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.869849 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.870016 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.870230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.870536 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.870706 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.870919 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.871180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.871504 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.871836 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.872149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.872475 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.872796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.873115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.873432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.873777 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.874156 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.874428 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.874580 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.874877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.875032 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.875301 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.875453 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.875666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.875819 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.876110 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.876259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.876451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.876607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.876842 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.877178 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.877346 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.877512 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.877877 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.878048 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.878193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.878334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.878614 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.878762 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.879009 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.879170 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.879321 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.879529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.879678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.879989 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.880136 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.880501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.880660 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.880802 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.880944 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.881124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.881281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.881429 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.881571 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.881783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.881936 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.882178 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.882428 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.883235 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.883384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.883525 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.883680 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.883823 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.883964 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.884103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.884269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.884568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.884731 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.884874 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.885034 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.885175 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.885408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.885623 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.885805 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.885983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.886142 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.886291 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.886434 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.886611 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.886767 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.886930 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.887092 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.887234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.887375 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.887556 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.887721 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.887940 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.888089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.888238 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.888389 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.888540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.888758 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.888909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.889051 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.889216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.889362 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.889511 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.889666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.889864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.890054 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.890203 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.890375 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.890522 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.890782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.890931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.891080 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.891233 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.891448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.891595 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.891778 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.891933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.892105 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.892260 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.892429 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.892656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.892802 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.892951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.893099 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.893415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.893679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.893856 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.894027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.894175 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.894356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.894772 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.894932 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.895076 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.895076 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.895351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.895597 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.895759 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.895902 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.896055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.896195 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.896337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.896484 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.896639 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.896781 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.896928 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.897070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.897210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.897363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.897504 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.897704 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.897931 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.898187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.898390 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.898574 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.898719 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.898860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.899008 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.899164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.899312 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.899462 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.899633 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.899786 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.899927 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.900161 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.900390 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.900549 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.900948 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.901117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.901261 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.901402 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.901556 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.901706 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.901881 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.902033 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.902176 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.902324 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.902488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.902657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.902894 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.903047 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.903197 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.903339 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.903493 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.903640 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.903789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.903937 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.904078 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.904256 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.904425 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.904568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.905032 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.905189 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.905339 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.905495 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.905732 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.905952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.906217 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.906377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.906525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.906677 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.906826 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.906984 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.907125 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.907271 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.907412 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.907560 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.907701 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.907841 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.907982 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.908128 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.908367 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.908524 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.908666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.908871 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.909030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.909173 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.909323 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.909465 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.909605 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.909766 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.909914 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.910066 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.910287 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.910431 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.910431 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.910705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.910851 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.911195 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.911358 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.911511 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.911661 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.911804 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.911950 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.912094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.912243 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.912385 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.912525 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.912525 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.912795 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.912795 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.913200 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.913350 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.913491 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.913632 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.913819 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.913979 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.914121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.914264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.914412 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.914559 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.914700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.914850 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.915026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.915331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.915480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.915624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.915846 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.916003 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.916145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.916286 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.916446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.916601 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.916752 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.916901 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.917049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.917201 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.917343 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.917491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.917646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.917825 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.917983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.918132 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.918274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.918500 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.918661 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.918804 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.918952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.919105 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.919246 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.919484 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.919656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.919809 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.919952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.920101 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.920245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.920402 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.920547 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.920547 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.920831 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.920982 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.921152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.921478 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.921624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.921785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.921943 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.922093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.922242 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.922397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.922550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.922699 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.922926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.923089 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.923327 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.923327 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.923602 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.923745 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.923886 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.924026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.924176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.924319 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.924467 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.924623 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.924766 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.924912 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.925857 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.926092 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.926243 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.926394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.926545 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.926697 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.926842 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.926984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.927125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.927267 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.927408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.927557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.927707 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.927853 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.928006 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.928155 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.928305 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.928481 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.928698 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.928845 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.928995 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.929139 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.929807 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.929963 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.930106 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.930259 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.930413 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.930555 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.930715 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.930860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.931003 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.931151 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.931319 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.931648 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.931818 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.931973 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.932124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.932284 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.932433 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.932611 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.932781 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.932931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.933079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.933275 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.933527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.933527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.933915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.933915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.934219 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.934368 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.934516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.934672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.934832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.934993 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.935149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.935299 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.935452 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.935609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.935609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.936230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.936390 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.936540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.936540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.936891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.937125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.937286 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.937443 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.937599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.937831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.937988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.938136 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.938283 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.938431 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.938586 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.938838 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.938838 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.939144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.939308 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.939458 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.939605 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.939761 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.939910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.940063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.940227 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.940379 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.940542 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.940699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.940848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.940848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.941150 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.941305 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.941467 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.941811 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.941971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.942120 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.942278 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.942435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.942594 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.942743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.942743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.943030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.943030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.943329 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.943503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.943736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.943890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.944044 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.944192 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.944420 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.944585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.944736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.944736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:35:48.945094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.945094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.945094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.945094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.945094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.946851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.946851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.946851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.947292 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.947440 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.947691 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.948010 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.948331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.948651 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.948970 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.949288 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.949619 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.949985 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.950318 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.950639 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.951066 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.951302 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.951878 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.952173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.952515 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.952848 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.953178 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.953503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.953857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.954192 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.954506 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.954818 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.955138 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.955455 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.955826 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.956210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.956513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.956803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.957188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.957478 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.958049 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.958407 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.958732 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.959065 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.959394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.959719 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.960031 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.960360 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.960703 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.961023 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.961347 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.961664 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.962027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.962892 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.962892 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.963082 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.963226 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.963550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.964042 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.964209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.964504 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.964871 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.965121 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.965443 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.965805 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.966095 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968943 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.968943 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.969183 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.969457 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.969784 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.970107 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.970435 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.970757 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.971093 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.971411 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.971790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.972225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_db.sqlalchemy.engines [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:35:48.974790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.974790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.974790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.974790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.974790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.974790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.975668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.975668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.975668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.976101 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.977450 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.977450 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.977450 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.978669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.978669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.978669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.978669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.979338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.979338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.979699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.979885 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.980241 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.980710 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.980880 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.981203 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.981622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.981864 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.982180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.982503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.982799 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.983121 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.983505 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.983775 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.984089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.984525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.984845 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.985171 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.985500 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.985843 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.986173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.986500 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.986823 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.987613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.987613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.987926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.988114 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.988447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.988779 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.989091 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.989402 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.989710 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.990055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.990391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.990727 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.991056 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.991384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.991789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.992728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.993045 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.993384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.993714 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.994071 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.994388 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.994727 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.995046 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.995366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.995685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.996004 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.996325 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.996642 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.996978 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.997338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.997886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.998043 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.998274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.998600 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.998926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.999244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.999579 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:48.999898 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.000223 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.000543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.000861 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.001188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.001510 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.001971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.002246 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.002580 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.002939 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.003267 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.003589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.003943 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.004279 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.004597 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.004916 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.005228 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 13:35:49.005477 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 13:35:49.028254 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_db.sqlalchemy.engines [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:35:49.041378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.context [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca99323b-21e3-4055-ab5d-fe0a9982137e(cell1) {{(pid=122612) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:35:49.045679 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:49.047283 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:49.048108 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:49.050068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:49.064533 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_db.sqlalchemy.engines [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:35:49.065859 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_db.sqlalchemy.engines [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:35:49.105244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.context [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ca99323b-21e3-4055-ab5d-fe0a9982137e(cell1) {{(pid=122611) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 13:35:49.109780 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:49.111367 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:49.112203 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:35:49.114183 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:35:49.127817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_db.sqlalchemy.engines [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:35:49.129364 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_db.sqlalchemy.engines [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:35:49.235367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_db.sqlalchemy.engines [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:35:49.291363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_db.sqlalchemy.engines [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 13:35:49.559142 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: WARNING keystonemiddleware.auth_token [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:35:49.565700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: WARNING keystonemiddleware.auth_token [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:35:49.622923 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: WARNING keystonemiddleware.auth_token [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:35:49.629463 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: WARNING keystonemiddleware.auth_token [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:35:49.909458 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: WARNING keystonemiddleware.auth_token [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:35:49.914735 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: WARNING keystonemiddleware.auth_token [None req-bd23b0d0-277f-401b-a33b-5f650e955186 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:35:49.920082 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c756c9f9c0 pid: 122612 (default app) Dec 15 13:35:49.971751 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: WARNING keystonemiddleware.auth_token [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 13:35:49.976976 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: WARNING keystonemiddleware.auth_token [None req-c3715974-71c9-46a9-af6f-8502acb03730 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 13:35:49.982372 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c756c9f9c0 pid: 122611 (default app) Dec 15 13:36:25.243413 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f4895821-1512-4356-849e-1fb87d8bcf13 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Action: 'create', calling method: .version_select at 0x7fd79dfb5e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1417933835"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:25.684111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e4b6ba56-abe4-4f90-888a-1e5e5ebb2163 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Action: 'create', calling method: .version_select at 0x7fd79dfb4e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1743139189", "metadata": {"Type": "work"}}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:27.215527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f4895821-1512-4356-849e-1fb87d8bcf13 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.410993 Dec 15 13:36:27.216489 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 1/1] 10.222.0.83 () {60 vars in 1154 bytes} [Wed Dec 15 13:36:23 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3413 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 13:36:27.384520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e4b6ba56-abe4-4f90-888a-1e5e5ebb2163 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.245069 Dec 15 13:36:27.386149 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 1/2] 10.222.0.83 () {60 vars in 1155 bytes} [Wed Dec 15 13:36:24 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3249 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 13:36:27.391541 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4fdc0f6c-8b0b-42f2-a335-366d530baa28 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79de899d0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:27.537724 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4fdc0f6c-8b0b-42f2-a335-366d530baa28 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5" status: 200 len: 345 microversion: 2.1 time: 0.150221 Dec 15 13:36:27.543750 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:27 2021] GET /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 => generated 345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:27.544762 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d975cfa8-b222-42d7-b0b0-1ce9f1c5ccb5 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79de89d30>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:27.667971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d975cfa8-b222-42d7-b0b0-1ce9f1c5ccb5 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 353 microversion: 2.1 time: 0.127025 Dec 15 13:36:27.669486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 3/4] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:27 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:27.813851 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1968494023", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "5d6416a0-3b53-483b-945b-ef82c2e0f162"}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:28.002610 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] validate_networks() for [('5d6416a0-3b53-483b-945b-ef82c2e0f162', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:36:28.551869 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d34fffa3-422d-4909-9c83-24d931c984e2 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79de213a0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:28.692863 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d34fffa3-422d-4909-9c83-24d931c984e2 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5" status: 200 len: 346 microversion: 2.1 time: 0.144253 Dec 15 13:36:28.694411 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 4/5] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:28 2021] GET /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:28.722006 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-423ab69a-ca8e-46fb-aa3e-67f880feb9fd tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79de21ca0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:28.836760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-423ab69a-ca8e-46fb-aa3e-67f880feb9fd tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 354 microversion: 2.1 time: 0.134236 Dec 15 13:36:28.845067 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 5/6] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:28 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:28.850262 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-771172e0-af6f-4201-b9dc-596f6f5daaa2 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Action: 'create', calling method: .version_select at 0x7fd79de21e50>, body: {"snapshot": {"volume_id": "2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1038736430"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:29.255540 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-771172e0-af6f-4201-b9dc-596f6f5daaa2 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.408196 Dec 15 13:36:29.257200 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 6/7] 10.222.0.83 () {60 vars in 1161 bytes} [Wed Dec 15 13:36:28 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:29.262849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-677c0ed6-a786-47b4-90c0-12509e56314f tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79de21160>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:29.390906 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-677c0ed6-a786-47b4-90c0-12509e56314f tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 354 microversion: 2.1 time: 0.132118 Dec 15 13:36:29.391479 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 7/8] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:29 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:29.405589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9889dde3-3e40-4907-ab76-57e6f922bfb0 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79de2b0d0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:29.487884 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9889dde3-3e40-4907-ab76-57e6f922bfb0 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 200 len: 287 microversion: 2.1 time: 0.085483 Dec 15 13:36:29.489372 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 8/9] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:29 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:29.495733 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-74cc6822-60b8-480a-8118-b8776bceae43 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79de89c10>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:29.612177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:36:29.613367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:36:29.613908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:36:29.614353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:36:29.614905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:36:29.656977 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:29.657435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:29.658434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:29.659146 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:29.695991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-74cc6822-60b8-480a-8118-b8776bceae43 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 202 len: 0 microversion: 2.1 time: 0.204471 Dec 15 13:36:29.697438 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 9/10] 10.222.0.83 () {58 vars in 1247 bytes} [Wed Dec 15 13:36:29 2021] DELETE /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:36:29.704542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ddb7f505-8367-4ee4-89c4-bf87845b4474 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79de21160>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:29.757033 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Getting quotas for project cbc3fb62e6fd4e12b55c29b671482f9d. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:29.775456 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Getting quotas for user 84d42046f04e4d819193d705bf4557f4 and project cbc3fb62e6fd4e12b55c29b671482f9d. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:29.775829 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ddb7f505-8367-4ee4-89c4-bf87845b4474 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.077156 Dec 15 13:36:29.776406 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 10/11] 10.222.0.83 () {58 vars in 1139 bytes} [Wed Dec 15 13:36:29 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:29.785227 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-316f9d60-7f8b-4ad2-8902-2cc28936f7c6 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79de2b670>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:29.810542 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:36:29.818389 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:36:29.910822 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-316f9d60-7f8b-4ad2-8902-2cc28936f7c6 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 353 microversion: 2.1 time: 0.133326 Dec 15 13:36:29.918778 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 11/12] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:29 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:29.924516 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-19946c4c-a19a-4968-ba7b-96046395b874 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79de21e50>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:29.974370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-19946c4c-a19a-4968-ba7b-96046395b874 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 200 len: 287 microversion: 2.1 time: 0.058165 Dec 15 13:36:29.975182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 12/13] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:29 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:30.006492 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-54c3b3d5-d72b-48b5-b253-e383d169c33f tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.787775 Dec 15 13:36:30.007677 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 2/14] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:36:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 2790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:36:30.017458 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-471f0a1d-a7e3-4a99-ab67-254dc5089d77 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:30.026207 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-471f0a1d-a7e3-4a99-ab67-254dc5089d77 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:30.246395 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-471f0a1d-a7e3-4a99-ab67-254dc5089d77 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:30.277477 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-471f0a1d-a7e3-4a99-ab67-254dc5089d77 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1215 microversion: 2.1 time: 0.262410 Dec 15 13:36:30.278213 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 13/15] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:30 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:30.927901 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ef67f43c-ee08-44f7-8d36-c333e8b0030f tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79dd9c700>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:30.988053 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-16fd34eb-1356-4642-8029-b092032dbf47 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79de89f70>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:31.014101 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ef67f43c-ee08-44f7-8d36-c333e8b0030f tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 353 microversion: 2.1 time: 0.090595 Dec 15 13:36:31.014925 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 3/16] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:30 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:31.081646 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-16fd34eb-1356-4642-8029-b092032dbf47 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 200 len: 287 microversion: 2.1 time: 0.097758 Dec 15 13:36:31.082240 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 14/17] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:30 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:31.294040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5d76b9cb-f2ed-4b46-928f-6a1301b9a982 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:31.294951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5d76b9cb-f2ed-4b46-928f-6a1301b9a982 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:31.440133 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5d76b9cb-f2ed-4b46-928f-6a1301b9a982 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:31.482453 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5d76b9cb-f2ed-4b46-928f-6a1301b9a982 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1215 microversion: 2.1 time: 0.191917 Dec 15 13:36:31.486242 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 4/18] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:31 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:32.029130 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c900f8f3-ab58-4ae6-bcda-6024bd768ff4 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79de89a60>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:32.124134 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c900f8f3-ab58-4ae6-bcda-6024bd768ff4 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 353 microversion: 2.1 time: 0.099520 Dec 15 13:36:32.125323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 5/19] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:32 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:32.131020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-df16527c-088e-495b-b17f-59e4207dbe54 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79d545ca0>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:32.190171 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-df16527c-088e-495b-b17f-59e4207dbe54 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 200 len: 287 microversion: 2.1 time: 0.062956 Dec 15 13:36:32.191393 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 6/20] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:32 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:32.316144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fe0edf91-1082-4c82-a6bb-4a8f0911b2ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'create', calling method: .version_select at 0x7fd79ddeab80>, body: {"keypair": {"name": "tempest-keypair-131519193"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:32.401663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-fe0edf91-1082-4c82-a6bb-4a8f0911b2ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:32.408531 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-fe0edf91-1082-4c82-a6bb-4a8f0911b2ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for user 825dcf92d1b64c3d8a6c3e41cec2c836 and project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:32.506048 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3831b628-3062-4a18-b9a5-16eec74a96f2 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:32.507271 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3831b628-3062-4a18-b9a5-16eec74a96f2 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:32.519284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3831b628-3062-4a18-b9a5-16eec74a96f2 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:32.520034 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3831b628-3062-4a18-b9a5-16eec74a96f2 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:32.521407 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3831b628-3062-4a18-b9a5-16eec74a96f2 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:32.522093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3831b628-3062-4a18-b9a5-16eec74a96f2 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:32.698183 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-fe0edf91-1082-4c82-a6bb-4a8f0911b2ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:32.702089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-fe0edf91-1082-4c82-a6bb-4a8f0911b2ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for user 825dcf92d1b64c3d8a6c3e41cec2c836 and project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:32.729352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fe0edf91-1082-4c82-a6bb-4a8f0911b2ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.845896 Dec 15 13:36:32.730316 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 15/21] 10.222.0.83 () {62 vars in 1198 bytes} [Wed Dec 15 13:36:31 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 848 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:36:32.857356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3831b628-3062-4a18-b9a5-16eec74a96f2 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:32.877535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3831b628-3062-4a18-b9a5-16eec74a96f2 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1219 microversion: 2.1 time: 0.380852 Dec 15 13:36:32.895231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 7/22] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:32 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1219 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:33.137411 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-64a2cb17-e0ed-42d5-ab96-b2fda91963cb tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79ddc4f70>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:33.207543 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-bca6f8cf-1d71-4d9a-a645-47ef09ba86b8 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79ccd89d0>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:33.277480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-bca6f8cf-1d71-4d9a-a645-47ef09ba86b8 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 200 len: 288 microversion: 2.1 time: 0.073723 Dec 15 13:36:33.278690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 8/23] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:33 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:33.416275 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-64a2cb17-e0ed-42d5-ab96-b2fda91963cb tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 353 microversion: 2.1 time: 0.283553 Dec 15 13:36:33.416972 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 16/24] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:33 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 353 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:33.422039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6294d5aa-cb90-4c9f-9947-70f28e24ab7c tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79d579160>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:33.535941 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6294d5aa-cb90-4c9f-9947-70f28e24ab7c tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "DELETE /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 202 len: 0 microversion: 2.1 time: 0.117494 Dec 15 13:36:33.536620 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 17/25] 10.222.0.83 () {58 vars in 1253 bytes} [Wed Dec 15 13:36:33 2021] DELETE /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:36:33.547279 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-508317e3-b476-47b2-a9e1-dca5763330ef tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79d579820>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:33.586364 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-116582500", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65892dc7-52b7-4275-99f0-3ec0b08be25d"}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:33.598933 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-508317e3-b476-47b2-a9e1-dca5763330ef tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 200 len: 287 microversion: 2.1 time: 0.056635 Dec 15 13:36:33.603603 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 18/26] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:33 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:33.705772 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] validate_networks() for [('65892dc7-52b7-4275-99f0-3ec0b08be25d', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:36:33.901567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3224ad23-e0fb-42cd-9d3f-2e94e94d36e5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:33.902382 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3224ad23-e0fb-42cd-9d3f-2e94e94d36e5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:33.918652 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3224ad23-e0fb-42cd-9d3f-2e94e94d36e5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:33.918652 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3224ad23-e0fb-42cd-9d3f-2e94e94d36e5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:33.919321 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3224ad23-e0fb-42cd-9d3f-2e94e94d36e5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:33.919693 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3224ad23-e0fb-42cd-9d3f-2e94e94d36e5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:34.307360 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3224ad23-e0fb-42cd-9d3f-2e94e94d36e5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:34.343719 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3224ad23-e0fb-42cd-9d3f-2e94e94d36e5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1267 microversion: 2.1 time: 0.447424 Dec 15 13:36:34.344314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 19/27] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:33 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1267 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:34.428945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f0ce4577-4b00-426f-a695-101905cbb7c6 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79ddd2280>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:34.530789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f0ce4577-4b00-426f-a695-101905cbb7c6 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 353 microversion: 2.1 time: 0.105690 Dec 15 13:36:34.531769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 20/28] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:34 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:34.615228 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c735ae35-1465-4127-8426-6f2438c7ba2e tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79d4f14c0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:34.673069 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c735ae35-1465-4127-8426-6f2438c7ba2e tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 200 len: 287 microversion: 2.1 time: 0.061342 Dec 15 13:36:34.674893 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 21/29] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:34 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:34.888923 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:36:34.889396 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:36:34.890179 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:36:34.890597 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:36:34.891011 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:36:34.904699 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:34.906292 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:34.907393 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:34.912202 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:34.952826 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Getting quotas for project 91da5641066242d99b74a660383a26da. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:34.957781 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Getting quotas for user 0a11e7a0c33b4df38bdb713cffe43911 and project 91da5641066242d99b74a660383a26da. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:34.977285 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:36:34.980765 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:36:35.080906 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-af2cba6f-4024-4bd8-981e-7031d50005d0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.796472 Dec 15 13:36:35.090460 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 9/30] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:36:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:36:35.094763 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b17d165b-781c-42ee-bdfd-b0a8e5153a45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:35.095606 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b17d165b-781c-42ee-bdfd-b0a8e5153a45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:35.226210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b17d165b-781c-42ee-bdfd-b0a8e5153a45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:35.234247 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b17d165b-781c-42ee-bdfd-b0a8e5153a45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1221 microversion: 2.1 time: 0.143310 Dec 15 13:36:35.235924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 22/31] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:35 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:35.363179 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3b808503-82af-4cec-ba5a-31b7d0d2bbe3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:35.363791 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3b808503-82af-4cec-ba5a-31b7d0d2bbe3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:35.374994 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3b808503-82af-4cec-ba5a-31b7d0d2bbe3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:35.375595 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3b808503-82af-4cec-ba5a-31b7d0d2bbe3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:35.379090 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3b808503-82af-4cec-ba5a-31b7d0d2bbe3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:35.380050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3b808503-82af-4cec-ba5a-31b7d0d2bbe3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:35.500743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-357215975", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65892dc7-52b7-4275-99f0-3ec0b08be25d"}]}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:35.508879 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3b808503-82af-4cec-ba5a-31b7d0d2bbe3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:35.520934 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3b808503-82af-4cec-ba5a-31b7d0d2bbe3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1267 microversion: 2.1 time: 0.162822 Dec 15 13:36:35.523144 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 10/32] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:35 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:35.553846 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-33c731b3-269d-4081-a53a-d0f6bdccae1f tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79cc22a60>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:35.620143 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.network.neutron [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] validate_networks() for [('65892dc7-52b7-4275-99f0-3ec0b08be25d', None, None, None, None, None)] {{(pid=122611) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:36:35.705576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-33c731b3-269d-4081-a53a-d0f6bdccae1f tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 200 len: 353 microversion: 2.1 time: 0.165315 Dec 15 13:36:35.706488 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 11/33] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:35 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:35.711033 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9c00d802-a890-46c5-ae01-822a231d54dd tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79cc25160>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:35.780079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9c00d802-a890-46c5-ae01-822a231d54dd tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 200 len: 287 microversion: 2.1 time: 0.072346 Dec 15 13:36:35.784155 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 12/34] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:35 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:36.542047 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f477e0ba-2ada-41ec-9237-f4be49a321a6 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:36.542825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f477e0ba-2ada-41ec-9237-f4be49a321a6 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:36.557630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f477e0ba-2ada-41ec-9237-f4be49a321a6 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:36.566712 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f477e0ba-2ada-41ec-9237-f4be49a321a6 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:36.573538 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f477e0ba-2ada-41ec-9237-f4be49a321a6 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:36.581588 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f477e0ba-2ada-41ec-9237-f4be49a321a6 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:36.973354 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f477e0ba-2ada-41ec-9237-f4be49a321a6 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:36.987486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f477e0ba-2ada-41ec-9237-f4be49a321a6 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1275 microversion: 2.1 time: 0.450110 Dec 15 13:36:36.992991 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 13/35] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:36 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1275 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:36.998171 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-18fb0591-995c-4900-8740-47e9fc4f67d9 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Calling method '.version_select at 0x7fd79cc22790>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:37.420708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-18fb0591-995c-4900-8740-47e9fc4f67d9 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] HTTP exception thrown: Volume 2c5d2385-f45e-46c5-8834-5094f7369224 could not be found. Dec 15 13:36:37.421410 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-18fb0591-995c-4900-8740-47e9fc4f67d9 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] Returning 404 to user: Volume 2c5d2385-f45e-46c5-8834-5094f7369224 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:37.422752 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-18fb0591-995c-4900-8740-47e9fc4f67d9 tempest-VolumesGetTestJSON-1974247166 tempest-VolumesGetTestJSON-1974247166-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224" status: 404 len: 109 microversion: 2.1 time: 0.428496 Dec 15 13:36:37.423946 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 14/36] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:36 2021] GET /compute/v2.1/os-volumes/2c5d2385-f45e-46c5-8834-5094f7369224 => generated 109 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:36:37.437783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6fae00a7-a0bd-425c-b751-506b9dced217 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79cc6f280>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:37.528736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-6fae00a7-a0bd-425c-b751-506b9dced217 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] HTTP exception thrown: Snapshot e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a could not be found. Dec 15 13:36:37.529549 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6fae00a7-a0bd-425c-b751-506b9dced217 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Returning 404 to user: Snapshot e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:37.531323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6fae00a7-a0bd-425c-b751-506b9dced217 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a" status: 404 len: 111 microversion: 2.1 time: 0.105401 Dec 15 13:36:37.532045 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 15/37] 10.222.0.83 () {58 vars in 1250 bytes} [Wed Dec 15 13:36:37 2021] GET /compute/v2.1/os-snapshots/e1b52a6a-7d0c-44a0-bac4-0aebc4c9fe5a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:36:37.540476 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-867743235", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a124ac63-e61f-437a-a1a8-96048fcd9353"}], "security_groups": [{"name": "tempest-securitygroup--2139572909"}], "key_name": "tempest-keypair-131519193", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:38.895111 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] validate_networks() for [('a124ac63-e61f-437a-a1a8-96048fcd9353', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:36:39.172225 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Flavor limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:36:39.172654 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Image limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:36:39.173076 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Flavor pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:36:39.173476 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Image pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:36:39.174206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:36:39.191158 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:39.191611 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:39.192416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:39.204017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:39.319587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Getting quotas for project 91da5641066242d99b74a660383a26da. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:39.329336 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Getting quotas for user 0a11e7a0c33b4df38bdb713cffe43911 and project 91da5641066242d99b74a660383a26da. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:39.350926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Going to run 1 instances... {{(pid=122611) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:36:39.354656 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:36:39.552769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f90ff38a-b3c2-420d-975e-991f1d839c3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.060981 Dec 15 13:36:39.553844 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 23/38] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:36:35 2021] POST /compute/v2.1/servers => generated 383 bytes in 4063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:36:39.580998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5c2d5ebf-0858-4145-8dde-599bb445838b tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79d433550>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:39.807913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5c2d5ebf-0858-4145-8dde-599bb445838b tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5" status: 202 len: 0 microversion: 2.1 time: 0.246330 Dec 15 13:36:39.810290 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 24/39] 10.222.0.83 () {58 vars in 1247 bytes} [Wed Dec 15 13:36:39 2021] DELETE /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:36:39.823937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cb2650c7-29bd-47d5-afe9-623ecb94a08a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:39.824610 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cb2650c7-29bd-47d5-afe9-623ecb94a08a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:39.842678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cb2650c7-29bd-47d5-afe9-623ecb94a08a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:39.846460 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cb2650c7-29bd-47d5-afe9-623ecb94a08a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:39.849149 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cb2650c7-29bd-47d5-afe9-623ecb94a08a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:39.850446 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cb2650c7-29bd-47d5-afe9-623ecb94a08a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:40.119234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-cb2650c7-29bd-47d5-afe9-623ecb94a08a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:40.128659 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cb2650c7-29bd-47d5-afe9-623ecb94a08a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1273 microversion: 2.1 time: 0.312860 Dec 15 13:36:40.135848 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 25/40] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:39 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1273 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:40.177165 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-017063a3-f8fd-4da1-803d-b73e1eb27f99 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:40.184748 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-017063a3-f8fd-4da1-803d-b73e1eb27f99 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:40.944734 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-017063a3-f8fd-4da1-803d-b73e1eb27f99 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:40.952576 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-017063a3-f8fd-4da1-803d-b73e1eb27f99 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1221 microversion: 2.1 time: 0.815642 Dec 15 13:36:40.958845 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 26/41] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:40 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1221 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:40.969007 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e6e3e5ba-ee07-4c24-b413-e36b0ec50efc tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79d433550>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:41.135553 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-e6e3e5ba-ee07-4c24-b413-e36b0ec50efc tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] HTTP exception thrown: Volume 2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 could not be found. Dec 15 13:36:41.138923 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e6e3e5ba-ee07-4c24-b413-e36b0ec50efc tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Returning 404 to user: Volume 2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:41.139937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e6e3e5ba-ee07-4c24-b413-e36b0ec50efc tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5" status: 404 len: 109 microversion: 2.1 time: 0.179837 Dec 15 13:36:41.144304 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 27/42] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:40 2021] GET /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 => generated 109 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:36:41.152575 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b34d84cb-e1c5-4bd0-b763-53c89fb54892 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79d433d30>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:41.286870 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-b34d84cb-e1c5-4bd0-b763-53c89fb54892 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] HTTP exception thrown: Volume 2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 could not be found. Dec 15 13:36:41.287665 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b34d84cb-e1c5-4bd0-b763-53c89fb54892 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Returning 404 to user: Volume 2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:41.288672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b34d84cb-e1c5-4bd0-b763-53c89fb54892 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5" status: 404 len: 109 microversion: 2.1 time: 0.142446 Dec 15 13:36:41.290366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 28/43] 10.222.0.83 () {58 vars in 1247 bytes} [Wed Dec 15 13:36:41 2021] DELETE /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:36:41.296254 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d69c6254-c9b1-4409-b33c-43daaa75608e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:41.298723 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d69c6254-c9b1-4409-b33c-43daaa75608e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:41.331496 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d69c6254-c9b1-4409-b33c-43daaa75608e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:41.331885 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d69c6254-c9b1-4409-b33c-43daaa75608e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:41.332866 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d69c6254-c9b1-4409-b33c-43daaa75608e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:41.333352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d69c6254-c9b1-4409-b33c-43daaa75608e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:42.019589 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:36:42.020084 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:36:42.020478 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:36:42.021038 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:36:42.021453 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:36:42.036879 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:42.037222 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:42.041715 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:42.043246 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:42.062994 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d69c6254-c9b1-4409-b33c-43daaa75608e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:42.064930 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:36:42.069009 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for user 825dcf92d1b64c3d8a6c3e41cec2c836 and project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:36:42.078752 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d69c6254-c9b1-4409-b33c-43daaa75608e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.784844 Dec 15 13:36:42.082177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 29/44] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:41 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:42.108466 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b7737d74-ad20-4fd9-ae80-b950c9219624 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Calling method '.version_select at 0x7fd79d449310>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:42.126407 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:36:42.128962 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:36:42.181154 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-b7737d74-ad20-4fd9-ae80-b950c9219624 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] HTTP exception thrown: Volume 2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 could not be found. Dec 15 13:36:42.181984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b7737d74-ad20-4fd9-ae80-b950c9219624 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] Returning 404 to user: Volume 2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:42.183235 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b7737d74-ad20-4fd9-ae80-b950c9219624 tempest-VolumesSnapshotsTestJSON-184696558 tempest-VolumesSnapshotsTestJSON-184696558-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5" status: 404 len: 109 microversion: 2.1 time: 0.099009 Dec 15 13:36:42.184432 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 30/45] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:42 2021] GET /compute/v2.1/os-volumes/2cfa09c0-1f73-420f-b6e1-6ad7674ed9f5 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:36:42.189655 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ddd544e8-b782-4915-a300-a18293578b0f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:42.194085 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ddd544e8-b782-4915-a300-a18293578b0f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:42.205178 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ddd544e8-b782-4915-a300-a18293578b0f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:42.205806 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ddd544e8-b782-4915-a300-a18293578b0f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:42.206758 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ddd544e8-b782-4915-a300-a18293578b0f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:42.207554 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ddd544e8-b782-4915-a300-a18293578b0f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:42.309336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-52043931-3967-470f-8cbc-619af9fad715 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.774555 Dec 15 13:36:42.312197 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 16/46] 10.222.0.83 () {62 vars in 1187 bytes} [Wed Dec 15 13:36:37 2021] POST /compute/v2.1/servers => generated 402 bytes in 4779 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 13:36:42.326749 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2c25070d-6352-43dc-bbf3-041ef70a0d02 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:42.327897 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2c25070d-6352-43dc-bbf3-041ef70a0d02 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:42.334895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ddd544e8-b782-4915-a300-a18293578b0f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:42.343746 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ddd544e8-b782-4915-a300-a18293578b0f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1273 microversion: 2.1 time: 0.157966 Dec 15 13:36:42.344525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 31/47] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:42 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:42.443945 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2c25070d-6352-43dc-bbf3-041ef70a0d02 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:42.455333 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2c25070d-6352-43dc-bbf3-041ef70a0d02 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:42.463401 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2c25070d-6352-43dc-bbf3-041ef70a0d02 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:42.464529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2c25070d-6352-43dc-bbf3-041ef70a0d02 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1280 microversion: 2.20 time: 0.147286 Dec 15 13:36:42.470156 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 17/48] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:42 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1280 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:43.102472 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-beee1268-2125-40f4-84ab-9356a63c6b07 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:43.103089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-beee1268-2125-40f4-84ab-9356a63c6b07 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:43.127460 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-beee1268-2125-40f4-84ab-9356a63c6b07 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:43.127816 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-beee1268-2125-40f4-84ab-9356a63c6b07 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:43.128844 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-beee1268-2125-40f4-84ab-9356a63c6b07 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:43.130101 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-beee1268-2125-40f4-84ab-9356a63c6b07 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:43.362246 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-03fda241-36e8-4d25-888e-0d18dbe84a7a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:43.364151 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-03fda241-36e8-4d25-888e-0d18dbe84a7a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:43.378815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-03fda241-36e8-4d25-888e-0d18dbe84a7a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:43.379219 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-03fda241-36e8-4d25-888e-0d18dbe84a7a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:43.381945 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-03fda241-36e8-4d25-888e-0d18dbe84a7a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:43.382500 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-03fda241-36e8-4d25-888e-0d18dbe84a7a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:43.821049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-03fda241-36e8-4d25-888e-0d18dbe84a7a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:43.834717 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-03fda241-36e8-4d25-888e-0d18dbe84a7a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1281 microversion: 2.1 time: 0.476271 Dec 15 13:36:43.837526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 18/49] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:43 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1281 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:36:43.858148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:43.858592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:43.876411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:43.876884 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:43.879974 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:43.883234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:44.311083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:44.328861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:44.330721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:44.335271 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-29248b8d-f7f7-48c6-9951-9de20b6ae3cb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1276 microversion: 2.20 time: 0.493423 Dec 15 13:36:44.356570 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 19/50] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:43 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1276 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:44.857528 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c7d52a85-0bd9-4772-812b-8b9e391e0a8d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:44.859764 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c7d52a85-0bd9-4772-812b-8b9e391e0a8d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:44.878225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c7d52a85-0bd9-4772-812b-8b9e391e0a8d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:44.884377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c7d52a85-0bd9-4772-812b-8b9e391e0a8d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:44.895654 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c7d52a85-0bd9-4772-812b-8b9e391e0a8d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:44.901995 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c7d52a85-0bd9-4772-812b-8b9e391e0a8d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:44.962890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-beee1268-2125-40f4-84ab-9356a63c6b07 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:44.987111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-beee1268-2125-40f4-84ab-9356a63c6b07 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 1.889515 Dec 15 13:36:44.990065 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 32/51] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:43 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:45.007865 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4601bfe5-e7b8-47fd-9a27-3912563ee5b8 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79d455670>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:45.107719 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4601bfe5-e7b8-47fd-9a27-3912563ee5b8 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/660c0d59-d0f3-4b87-85f6-1a63c12177fe" status: 200 len: 350 microversion: 2.1 time: 0.116118 Dec 15 13:36:45.108787 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 33/52] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:44 2021] GET /compute/v2.1/os-volumes/660c0d59-d0f3-4b87-85f6-1a63c12177fe => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:45.167555 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c7d52a85-0bd9-4772-812b-8b9e391e0a8d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:45.176750 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c7d52a85-0bd9-4772-812b-8b9e391e0a8d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1279 microversion: 2.1 time: 0.323745 Dec 15 13:36:45.184516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 20/53] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:44 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:45.362990 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:45.364062 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:45.375553 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:45.377005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:45.380734 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:45.381479 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:45.479490 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-26d939d8-8fa0-45e7-8b7e-df681e0323d5 req-2f368168-2cb4-4015-a323-00a9f5ec868e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f740a90-17ff-49e3-8f5d-f1450ae6baf0", "tag": "8265af4f-8d5b-423a-84c5-273348379f9f"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:45.488729 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:36:45.488729 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:36:45.505848 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-26d939d8-8fa0-45e7-8b7e-df681e0323d5 req-2f368168-2cb4-4015-a323-00a9f5ec868e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:45.507062 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-26d939d8-8fa0-45e7-8b7e-df681e0323d5 req-2f368168-2cb4-4015-a323-00a9f5ec868e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:45.603300 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-26d939d8-8fa0-45e7-8b7e-df681e0323d5 req-2f368168-2cb4-4015-a323-00a9f5ec868e service nova] Creating event network-changed:8265af4f-8d5b-423a-84c5-273348379f9f for instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 on hv-cinder-81322 Dec 15 13:36:45.603876 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-26d939d8-8fa0-45e7-8b7e-df681e0323d5 req-2f368168-2cb4-4015-a323-00a9f5ec868e service nova] Acquired lock "compute-rpcapi-router" {{(pid=122611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 13:36:45.606255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:45.606653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-90d60b1b-bf4f-42d4-a8b7-c35155da35db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:45.609552 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-90d60b1b-bf4f-42d4-a8b7-c35155da35db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:45.610716 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-90d60b1b-bf4f-42d4-a8b7-c35155da35db None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:45.613275 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-90d60b1b-bf4f-42d4-a8b7-c35155da35db None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:45.635140 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:45.636774 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:45.643737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b9dfc358-52e3-487d-b6eb-f4fe3835b3fe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1332 microversion: 2.20 time: 0.284605 Dec 15 13:36:45.650949 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 21/54] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:45 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1332 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:36:45.693108 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.compute.rpcapi [None req-90d60b1b-bf4f-42d4-a8b7-c35155da35db None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 13:36:45.700213 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-90d60b1b-bf4f-42d4-a8b7-c35155da35db None None] Releasing lock "compute-rpcapi-router" {{(pid=122611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 13:36:45.800865 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-90d60b1b-bf4f-42d4-a8b7-c35155da35db None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.690619 Dec 15 13:36:45.801625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 34/55] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:36:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:46.004079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4731c6e7-7040-44d0-8fe1-846913ee6b3d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:46.004690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4731c6e7-7040-44d0-8fe1-846913ee6b3d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:46.016404 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4731c6e7-7040-44d0-8fe1-846913ee6b3d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:46.016817 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4731c6e7-7040-44d0-8fe1-846913ee6b3d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:46.017605 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4731c6e7-7040-44d0-8fe1-846913ee6b3d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:46.031427 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4731c6e7-7040-44d0-8fe1-846913ee6b3d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:46.201498 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b3f3bcf4-61c7-4e8c-a903-c079e640570f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:46.202349 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b3f3bcf4-61c7-4e8c-a903-c079e640570f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:46.214125 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b3f3bcf4-61c7-4e8c-a903-c079e640570f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:46.214633 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b3f3bcf4-61c7-4e8c-a903-c079e640570f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:46.220293 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b3f3bcf4-61c7-4e8c-a903-c079e640570f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:46.220859 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b3f3bcf4-61c7-4e8c-a903-c079e640570f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:46.944879 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4731c6e7-7040-44d0-8fe1-846913ee6b3d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:46.961772 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4731c6e7-7040-44d0-8fe1-846913ee6b3d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.959329 Dec 15 13:36:46.963877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 22/56] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:45 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:46.972655 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:46.973340 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:46.991702 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:46.992796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:47.015785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:47.019680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:47.260405 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:47.276030 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:47.283060 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:47.284395 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3da2670f-8307-4bcd-ab5d-2bcb598885a5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1338 microversion: 2.20 time: 0.318760 Dec 15 13:36:47.287227 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 23/57] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:46 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1338 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:47.364880 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b3f3bcf4-61c7-4e8c-a903-c079e640570f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:47.377400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b3f3bcf4-61c7-4e8c-a903-c079e640570f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 1.179032 Dec 15 13:36:47.379996 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 35/58] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:46 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:47.390483 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b397081f-6613-48a3-a8ba-4e682f997155 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79c3ef310>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:47.505705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b397081f-6613-48a3-a8ba-4e682f997155 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/2430570b-ffe1-4d0c-b42b-dadc7fa837bb" status: 200 len: 351 microversion: 2.1 time: 0.124347 Dec 15 13:36:47.506366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 36/59] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:47 2021] GET /compute/v2.1/os-volumes/2430570b-ffe1-4d0c-b42b-dadc7fa837bb => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:47.790946 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0f987086-9a49-43b0-bf76-98384fa10917 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Action: 'create', calling method: .version_select at 0x7fd79cc35280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-153914334", "metadata": {"Type": "work"}}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:47.793085 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0f987086-9a49-43b0-bf76-98384fa10917 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:47.794192 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0f987086-9a49-43b0-bf76-98384fa10917 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.505989 Dec 15 13:36:47.798544 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 24/60] 10.222.0.83 () {60 vars in 1155 bytes} [Wed Dec 15 13:36:47 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 511 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:36:47.821622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-234794b3-de5e-4df3-a80e-a6a4aa372e17 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Action: 'create', calling method: .version_select at 0x7fd79cc25ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-430117275", "metadata": {"Type": "work"}}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:47.823964 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-234794b3-de5e-4df3-a80e-a6a4aa372e17 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:47.828020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-234794b3-de5e-4df3-a80e-a6a4aa372e17 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022725 Dec 15 13:36:47.845666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-9884b0e7-8d00-4a2d-9d0e-563f2a2855f8 req-a31acd05-707b-4bc7-bf0c-bbdd4f633deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53bb255-30a9-4c8c-b637-c9f371b04944", "tag": "ba9131b0-fdf7-4ed2-a8c9-1c6801656498"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:47.850218 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:36:47.850218 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:36:47.853536 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 25/61] 10.222.0.83 () {60 vars in 1155 bytes} [Wed Dec 15 13:36:47 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:36:47.887392 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-39dc7c9c-31ad-4ceb-9180-697d2a60e34e tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Action: 'create', calling method: .version_select at 0x7fd79d5459d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-578406296", "metadata": {"Type": "work"}}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:47.894532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-39dc7c9c-31ad-4ceb-9180-697d2a60e34e tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:47.902845 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-39dc7c9c-31ad-4ceb-9180-697d2a60e34e tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.041621 Dec 15 13:36:47.906002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 26/62] 10.222.0.83 () {60 vars in 1155 bytes} [Wed Dec 15 13:36:47 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:36:47.914975 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-9884b0e7-8d00-4a2d-9d0e-563f2a2855f8 req-a31acd05-707b-4bc7-bf0c-bbdd4f633deb service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:47.917189 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-9884b0e7-8d00-4a2d-9d0e-563f2a2855f8 req-a31acd05-707b-4bc7-bf0c-bbdd4f633deb service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:47.952699 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9af73210-5f14-4150-8bb0-3b5e44ae355e tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Calling method '.version_select at 0x7fd79cc35af0>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:47.987320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-9884b0e7-8d00-4a2d-9d0e-563f2a2855f8 req-a31acd05-707b-4bc7-bf0c-bbdd4f633deb service nova] Creating event network-changed:ba9131b0-fdf7-4ed2-a8c9-1c6801656498 for instance f53bb255-30a9-4c8c-b637-c9f371b04944 on hv-cinder-81322 Dec 15 13:36:48.001674 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-9884b0e7-8d00-4a2d-9d0e-563f2a2855f8 req-a31acd05-707b-4bc7-bf0c-bbdd4f633deb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301648 Dec 15 13:36:48.005423 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 37/63] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:36:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:48.024735 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3d8151e6-37f1-44a4-ba40-daeec2032ca3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:48.025798 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3d8151e6-37f1-44a4-ba40-daeec2032ca3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:48.058435 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d8151e6-37f1-44a4-ba40-daeec2032ca3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:48.060772 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d8151e6-37f1-44a4-ba40-daeec2032ca3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:48.061736 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d8151e6-37f1-44a4-ba40-daeec2032ca3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:48.063398 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d8151e6-37f1-44a4-ba40-daeec2032ca3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:48.072594 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-9af73210-5f14-4150-8bb0-3b5e44ae355e tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] HTTP exception thrown: Volume tempest-invalid-1355473435 could not be found. Dec 15 13:36:48.073446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9af73210-5f14-4150-8bb0-3b5e44ae355e tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Returning 404 to user: Volume tempest-invalid-1355473435 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:48.074843 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9af73210-5f14-4150-8bb0-3b5e44ae355e tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1355473435" status: 404 len: 99 microversion: 2.1 time: 0.159445 Dec 15 13:36:48.080749 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 27/64] 10.222.0.83 () {58 vars in 1217 bytes} [Wed Dec 15 13:36:47 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1355473435 => generated 99 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 15 13:36:48.088625 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-83da8f76-ab42-466f-87c3-e553a298b682 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006653 Dec 15 13:36:48.089263 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 28/65] 10.222.0.83 () {58 vars in 1139 bytes} [Wed Dec 15 13:36:48 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 13:36:48.108236 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d26ba5ff-74b1-45a6-ad58-e4e4df06c121 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011583 Dec 15 13:36:48.115292 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 29/66] 10.222.0.83 () {58 vars in 1136 bytes} [Wed Dec 15 13:36:48 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 13:36:48.126510 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-209423dd-81a6-48dd-9ed6-8836618db0f2 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Calling method '.version_select at 0x7fd79cc7dca0>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:48.207448 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-209423dd-81a6-48dd-9ed6-8836618db0f2 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] HTTP exception thrown: Volume 5b91fd81-5a7a-49f5-b4da-16b117673d2a could not be found. Dec 15 13:36:48.208476 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-209423dd-81a6-48dd-9ed6-8836618db0f2 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Returning 404 to user: Volume 5b91fd81-5a7a-49f5-b4da-16b117673d2a could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:48.209508 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-209423dd-81a6-48dd-9ed6-8836618db0f2 tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/5b91fd81-5a7a-49f5-b4da-16b117673d2a" status: 404 len: 109 microversion: 2.1 time: 0.087576 Dec 15 13:36:48.210292 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 30/67] 10.222.0.83 () {58 vars in 1247 bytes} [Wed Dec 15 13:36:48 2021] DELETE /compute/v2.1/os-volumes/5b91fd81-5a7a-49f5-b4da-16b117673d2a => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:36:48.220297 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5fd065e8-a888-4cbd-bf61-6073a9c35acc tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Calling method '.version_select at 0x7fd79cc35280>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:48.290306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-5fd065e8-a888-4cbd-bf61-6073a9c35acc tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] HTTP exception thrown: Volume 7511d82f-feb0-4687-b90c-b1c054aa3346 could not be found. Dec 15 13:36:48.291307 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5fd065e8-a888-4cbd-bf61-6073a9c35acc tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] Returning 404 to user: Volume 7511d82f-feb0-4687-b90c-b1c054aa3346 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:36:48.295691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5fd065e8-a888-4cbd-bf61-6073a9c35acc tempest-VolumesNegativeTest-1403927818 tempest-VolumesNegativeTest-1403927818-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/7511d82f-feb0-4687-b90c-b1c054aa3346" status: 404 len: 109 microversion: 2.1 time: 0.078111 Dec 15 13:36:48.296278 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 31/68] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:48 2021] GET /compute/v2.1/os-volumes/7511d82f-feb0-4687-b90c-b1c054aa3346 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:36:48.336338 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:48.337774 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:48.374186 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:48.374838 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:48.377845 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:48.379413 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:48.656206 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:48.670630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:48.672503 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:48.682691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-59e92228-396b-401d-9936-e1162e0ce387 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1338 microversion: 2.20 time: 0.370723 Dec 15 13:36:48.683568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 32/69] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:48 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1338 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:48.701053 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-29b788b3-3d01-49ae-bafd-94419df7033f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:48.702319 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-29b788b3-3d01-49ae-bafd-94419df7033f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:48.712074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-29b788b3-3d01-49ae-bafd-94419df7033f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:48.712693 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-29b788b3-3d01-49ae-bafd-94419df7033f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:48.713904 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-29b788b3-3d01-49ae-bafd-94419df7033f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:48.714904 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-29b788b3-3d01-49ae-bafd-94419df7033f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:49.008640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3d8151e6-37f1-44a4-ba40-daeec2032ca3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:49.019448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3d8151e6-37f1-44a4-ba40-daeec2032ca3 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 1.011860 Dec 15 13:36:49.021117 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 38/70] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:48 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:49.170358 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5d8f28f1-4454-43c1-8afa-a675d8d3c094 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79d4554c0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:49.262695 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5d8f28f1-4454-43c1-8afa-a675d8d3c094 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/420a1120-77e8-47e2-8d45-89653d4facaf" status: 200 len: 350 microversion: 2.1 time: 0.096695 Dec 15 13:36:49.275164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 39/71] 10.222.0.83 () {58 vars in 1244 bytes} [Wed Dec 15 13:36:49 2021] GET /compute/v2.1/os-volumes/420a1120-77e8-47e2-8d45-89653d4facaf => generated 350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:49.281043 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-61efe134-318b-478a-82d4-1b7760ea74e8 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79c3dfc10>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:49.440822 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-61efe134-318b-478a-82d4-1b7760ea74e8 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.163955 Dec 15 13:36:49.451215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 40/72] 10.222.0.83 () {58 vars in 1133 bytes} [Wed Dec 15 13:36:49 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:49.461789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-004ed7cf-135b-487d-897b-8279785f12b1 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79d433f70>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:49.671188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-004ed7cf-135b-487d-897b-8279785f12b1 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.218476 Dec 15 13:36:49.679441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 41/73] 10.222.0.83 () {58 vars in 1148 bytes} [Wed Dec 15 13:36:49 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:49.685353 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-18736244-6920-4ab4-bd54-97b591740eb4 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79d455e50>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:49.884182 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-29b788b3-3d01-49ae-bafd-94419df7033f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:49.907460 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-29b788b3-3d01-49ae-bafd-94419df7033f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 1.217823 Dec 15 13:36:49.909902 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 33/74] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:48 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:49.917869 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-18736244-6920-4ab4-bd54-97b591740eb4 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.237093 Dec 15 13:36:49.930462 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 42/75] 10.222.0.83 () {58 vars in 1133 bytes} [Wed Dec 15 13:36:49 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:49.939927 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:49.947739 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-c029f502-2264-47c0-bd3c-6cc245e0cfec req-ba057597-7923-4f62-883b-032f18c7eff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06bee9b6-80cd-4147-b4a8-5919d331342e", "tag": "b2a560ce-9e8c-40f7-9de3-fc3410722da3"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:49.950210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:36:49.950210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:36:49.950391 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:49.978892 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:49.979419 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:49.980317 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:49.980756 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:50.047192 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-c029f502-2264-47c0-bd3c-6cc245e0cfec req-ba057597-7923-4f62-883b-032f18c7eff1 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:50.051080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-c029f502-2264-47c0-bd3c-6cc245e0cfec req-ba057597-7923-4f62-883b-032f18c7eff1 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:50.095134 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-c029f502-2264-47c0-bd3c-6cc245e0cfec req-ba057597-7923-4f62-883b-032f18c7eff1 service nova] Creating event network-changed:b2a560ce-9e8c-40f7-9de3-fc3410722da3 for instance 06bee9b6-80cd-4147-b4a8-5919d331342e on hv-cinder-81322 Dec 15 13:36:50.108461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-c029f502-2264-47c0-bd3c-6cc245e0cfec req-ba057597-7923-4f62-883b-032f18c7eff1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176283 Dec 15 13:36:50.109834 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 43/76] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:36:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:50.127193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d5c09aa1-1958-430f-a192-f33436ab06b9 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79c3dfaf0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:50.268043 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d5c09aa1-1958-430f-a192-f33436ab06b9 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.155341 Dec 15 13:36:50.269181 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 44/77] 10.222.0.83 () {58 vars in 1166 bytes} [Wed Dec 15 13:36:50 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:50.274159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ed0a4147-7de1-462f-ae57-39b575f35577 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:50.275203 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ed0a4147-7de1-462f-ae57-39b575f35577 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:50.282985 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed0a4147-7de1-462f-ae57-39b575f35577 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:50.283709 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed0a4147-7de1-462f-ae57-39b575f35577 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:50.284728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed0a4147-7de1-462f-ae57-39b575f35577 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:50.285359 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed0a4147-7de1-462f-ae57-39b575f35577 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:50.906001 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ed0a4147-7de1-462f-ae57-39b575f35577 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:50.915925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ed0a4147-7de1-462f-ae57-39b575f35577 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.645293 Dec 15 13:36:50.916505 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 45/78] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:50 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:50.939948 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-eb59def5-27b2-4c6e-96c0-ad419294aaaf tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79c3dfca0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:51.097103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:51.114686 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:51.118077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:51.121648 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-bac69a29-afbf-4c22-8158-631f5366cde6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 1.209254 Dec 15 13:36:51.122386 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 34/79] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:49 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:51.144560 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0b785cc8-c822-4463-94b9-6ba3ddb83ddd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:51.146789 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0b785cc8-c822-4463-94b9-6ba3ddb83ddd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:51.162199 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0b785cc8-c822-4463-94b9-6ba3ddb83ddd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:51.165275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0b785cc8-c822-4463-94b9-6ba3ddb83ddd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:51.166330 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0b785cc8-c822-4463-94b9-6ba3ddb83ddd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:51.168476 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0b785cc8-c822-4463-94b9-6ba3ddb83ddd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:51.334134 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-eb59def5-27b2-4c6e-96c0-ad419294aaaf tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.416429 Dec 15 13:36:51.343058 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 46/80] 10.222.0.83 () {58 vars in 1169 bytes} [Wed Dec 15 13:36:50 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:36:51.348216 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2d3b1548-1a0a-477c-80dc-909fb3740a9c tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79d4554c0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:51.476630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0b785cc8-c822-4463-94b9-6ba3ddb83ddd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:51.490734 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0b785cc8-c822-4463-94b9-6ba3ddb83ddd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.352968 Dec 15 13:36:51.492618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 35/81] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:51 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:51.493082 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2d3b1548-1a0a-477c-80dc-909fb3740a9c tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.148682 Dec 15 13:36:51.500115 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 47/82] 10.222.0.83 () {58 vars in 1154 bytes} [Wed Dec 15 13:36:51 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:51.505600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4ae4b6b5-4c37-4cd4-8c89-edf530278ba2 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79cc25700>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:51.601114 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4ae4b6b5-4c37-4cd4-8c89-edf530278ba2 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099894 Dec 15 13:36:51.602636 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 36/83] 10.222.0.83 () {58 vars in 1187 bytes} [Wed Dec 15 13:36:51 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:36:51.614731 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c93f8b4b-4f68-46b7-9952-fac296ce9ba4 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] Calling method '.version_select at 0x7fd79c3c14c0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:51.719874 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c93f8b4b-4f68-46b7-9952-fac296ce9ba4 tempest-VolumesTestJSON-374184021 tempest-VolumesTestJSON-374184021-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.109398 Dec 15 13:36:51.720454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 48/84] 10.222.0.83 () {58 vars in 1154 bytes} [Wed Dec 15 13:36:51 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:51.937833 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-547c94a5-e06b-4206-9be0-b557fa1a1665 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:51.939499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-547c94a5-e06b-4206-9be0-b557fa1a1665 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:51.951772 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-547c94a5-e06b-4206-9be0-b557fa1a1665 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:51.952764 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-547c94a5-e06b-4206-9be0-b557fa1a1665 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:51.953801 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-547c94a5-e06b-4206-9be0-b557fa1a1665 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:51.954378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-547c94a5-e06b-4206-9be0-b557fa1a1665 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:52.139648 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:52.140263 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:52.150673 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:52.151640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:52.152684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:52.153518 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:52.342499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-547c94a5-e06b-4206-9be0-b557fa1a1665 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:52.353781 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-547c94a5-e06b-4206-9be0-b557fa1a1665 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.421937 Dec 15 13:36:52.354597 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 37/85] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:51 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:52.507210 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-67ddeaf9-74cb-4c17-a191-e3569102a8f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:52.508387 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-67ddeaf9-74cb-4c17-a191-e3569102a8f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:52.523101 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-67ddeaf9-74cb-4c17-a191-e3569102a8f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:52.524658 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:52.527226 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-67ddeaf9-74cb-4c17-a191-e3569102a8f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:52.528297 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-67ddeaf9-74cb-4c17-a191-e3569102a8f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:52.531068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-67ddeaf9-74cb-4c17-a191-e3569102a8f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:52.532559 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:52.534102 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:52.539562 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4ee2e82a-f0d3-4f53-b12a-fbbc2cb24890 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.403522 Dec 15 13:36:52.541548 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 49/86] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:52 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:36:52.662525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-a21c7031-a6e6-440c-879d-b511f0dab3c2 req-521b11a7-eb5a-4850-8afe-9e470acef4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16af4c97-7ce7-47dd-8493-24d19a46221d", "tag": "e4b8c97b-020a-4806-8f09-f876ba55ad9d"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:36:52.664463 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:36:52.664463 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:36:52.672982 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-a21c7031-a6e6-440c-879d-b511f0dab3c2 req-521b11a7-eb5a-4850-8afe-9e470acef4cd service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:52.673963 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-a21c7031-a6e6-440c-879d-b511f0dab3c2 req-521b11a7-eb5a-4850-8afe-9e470acef4cd service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:52.686923 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-a21c7031-a6e6-440c-879d-b511f0dab3c2 req-521b11a7-eb5a-4850-8afe-9e470acef4cd service nova] Creating event network-changed:e4b8c97b-020a-4806-8f09-f876ba55ad9d for instance 16af4c97-7ce7-47dd-8493-24d19a46221d on hv-cinder-81322 Dec 15 13:36:52.700817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-a21c7031-a6e6-440c-879d-b511f0dab3c2 req-521b11a7-eb5a-4850-8afe-9e470acef4cd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041832 Dec 15 13:36:52.703415 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 50/87] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:36:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:36:53.149254 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-67ddeaf9-74cb-4c17-a191-e3569102a8f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:53.161229 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-67ddeaf9-74cb-4c17-a191-e3569102a8f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.657682 Dec 15 13:36:53.162399 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 38/88] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:52 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:53.371754 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-37276e14-f9f3-42cd-9434-76641c9126a9 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:53.372665 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-37276e14-f9f3-42cd-9434-76641c9126a9 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:53.385481 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-37276e14-f9f3-42cd-9434-76641c9126a9 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:53.388019 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-37276e14-f9f3-42cd-9434-76641c9126a9 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:53.390775 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-37276e14-f9f3-42cd-9434-76641c9126a9 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:53.393849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-37276e14-f9f3-42cd-9434-76641c9126a9 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:53.566142 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:53.569691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:53.579341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:53.580224 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:53.582027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:53.582956 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:53.800908 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-37276e14-f9f3-42cd-9434-76641c9126a9 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:53.810815 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-37276e14-f9f3-42cd-9434-76641c9126a9 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.443438 Dec 15 13:36:53.829988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 51/89] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:53 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:53.920018 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:53.930300 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:53.936969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:53.944251 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-055098f5-119f-4993-9934-e95bef3d95d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.379602 Dec 15 13:36:53.963546 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 39/90] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:53 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:54.180050 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-556a0c71-8e96-4727-bd2b-ec8f86b0c4d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:54.180671 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-556a0c71-8e96-4727-bd2b-ec8f86b0c4d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:54.191844 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-556a0c71-8e96-4727-bd2b-ec8f86b0c4d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:54.192314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-556a0c71-8e96-4727-bd2b-ec8f86b0c4d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:54.193102 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-556a0c71-8e96-4727-bd2b-ec8f86b0c4d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:54.193548 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-556a0c71-8e96-4727-bd2b-ec8f86b0c4d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:54.437196 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-556a0c71-8e96-4727-bd2b-ec8f86b0c4d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:54.445793 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-556a0c71-8e96-4727-bd2b-ec8f86b0c4d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.269751 Dec 15 13:36:54.446366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 52/91] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:54 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:54.828051 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a88b0516-1fec-45c9-9465-a82a5debbd3a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:54.829332 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a88b0516-1fec-45c9-9465-a82a5debbd3a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:54.836734 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a88b0516-1fec-45c9-9465-a82a5debbd3a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:54.839195 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a88b0516-1fec-45c9-9465-a82a5debbd3a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:54.842495 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a88b0516-1fec-45c9-9465-a82a5debbd3a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:54.843176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a88b0516-1fec-45c9-9465-a82a5debbd3a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:54.970297 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:54.971542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:54.980451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:54.981255 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:54.982399 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:54.983044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:55.344974 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a88b0516-1fec-45c9-9465-a82a5debbd3a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:55.352429 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a88b0516-1fec-45c9-9465-a82a5debbd3a tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.528048 Dec 15 13:36:55.361775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 40/92] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:54 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:55.375025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:55.384647 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:55.386489 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:55.387957 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d7e2eba3-c010-4af0-bdcc-ed7f38392a03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.421275 Dec 15 13:36:55.388481 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 53/93] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:54 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:55.462968 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4d059e13-f7a0-4c7b-a6c0-7a8c8d10c3d6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:55.464217 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4d059e13-f7a0-4c7b-a6c0-7a8c8d10c3d6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:55.471951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4d059e13-f7a0-4c7b-a6c0-7a8c8d10c3d6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:55.477295 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4d059e13-f7a0-4c7b-a6c0-7a8c8d10c3d6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:55.487577 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4d059e13-f7a0-4c7b-a6c0-7a8c8d10c3d6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:55.487577 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4d059e13-f7a0-4c7b-a6c0-7a8c8d10c3d6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:55.718464 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4d059e13-f7a0-4c7b-a6c0-7a8c8d10c3d6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:55.725621 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4d059e13-f7a0-4c7b-a6c0-7a8c8d10c3d6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.266317 Dec 15 13:36:55.726249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 41/94] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:55 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:56.370563 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-bfa8ec29-a4cc-4655-831d-29769764b513 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:56.371221 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-bfa8ec29-a4cc-4655-831d-29769764b513 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:56.378158 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bfa8ec29-a4cc-4655-831d-29769764b513 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:56.378605 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bfa8ec29-a4cc-4655-831d-29769764b513 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:56.379392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bfa8ec29-a4cc-4655-831d-29769764b513 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:56.379820 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bfa8ec29-a4cc-4655-831d-29769764b513 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:56.406815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:56.407424 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:56.415148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:56.415613 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:56.417393 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:56.418233 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:56.629425 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-bfa8ec29-a4cc-4655-831d-29769764b513 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:56.636804 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-bfa8ec29-a4cc-4655-831d-29769764b513 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.270363 Dec 15 13:36:56.637379 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 54/95] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:56 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:56.682334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:56.690666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:56.692364 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:56.693825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-15470a21-c63c-4b92-955a-5c4fb1586f22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.291558 Dec 15 13:36:56.694388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 42/96] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:56 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:36:56.744185 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ed8d00fd-a7cf-4328-bf16-89648c393a18 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:56.745144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ed8d00fd-a7cf-4328-bf16-89648c393a18 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:56.751452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed8d00fd-a7cf-4328-bf16-89648c393a18 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:56.752077 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed8d00fd-a7cf-4328-bf16-89648c393a18 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:56.752904 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed8d00fd-a7cf-4328-bf16-89648c393a18 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:56.753512 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed8d00fd-a7cf-4328-bf16-89648c393a18 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:56.922211 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ed8d00fd-a7cf-4328-bf16-89648c393a18 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:56.930946 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ed8d00fd-a7cf-4328-bf16-89648c393a18 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.190205 Dec 15 13:36:56.939522 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 55/97] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:56 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:57.662640 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c611d870-e87e-4acd-a843-0486f183dc08 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:57.663309 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c611d870-e87e-4acd-a843-0486f183dc08 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:57.669275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c611d870-e87e-4acd-a843-0486f183dc08 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:57.669599 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c611d870-e87e-4acd-a843-0486f183dc08 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:57.670493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c611d870-e87e-4acd-a843-0486f183dc08 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:57.670924 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c611d870-e87e-4acd-a843-0486f183dc08 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:57.712539 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:57.713146 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:57.723955 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:57.726542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:57.727696 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:57.728193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:57.914753 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c611d870-e87e-4acd-a843-0486f183dc08 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:57.919126 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:57.929860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:57.935229 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c611d870-e87e-4acd-a843-0486f183dc08 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.276348 Dec 15 13:36:57.936269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 43/98] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:57 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:57.946637 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:57.950325 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a288c00a-144d-4721-905e-c6feedd826d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:57.950900 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-812d42a4-2117-4488-a9fc-7aed40b01d5b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.239148 Dec 15 13:36:57.951024 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a288c00a-144d-4721-905e-c6feedd826d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:57.953879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 56/99] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:57 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:36:57.956658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a288c00a-144d-4721-905e-c6feedd826d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:57.957100 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a288c00a-144d-4721-905e-c6feedd826d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:57.957893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a288c00a-144d-4721-905e-c6feedd826d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:57.958320 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a288c00a-144d-4721-905e-c6feedd826d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:58.150139 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a288c00a-144d-4721-905e-c6feedd826d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:58.160916 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a288c00a-144d-4721-905e-c6feedd826d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.217700 Dec 15 13:36:58.163019 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 44/100] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:57 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:58.954159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-73f2f599-d6e3-4eb6-8b08-d391224a92dc tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:58.954764 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-73f2f599-d6e3-4eb6-8b08-d391224a92dc tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:58.960520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-73f2f599-d6e3-4eb6-8b08-d391224a92dc tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:58.961159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-73f2f599-d6e3-4eb6-8b08-d391224a92dc tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:58.961974 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-73f2f599-d6e3-4eb6-8b08-d391224a92dc tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:58.962412 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-73f2f599-d6e3-4eb6-8b08-d391224a92dc tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:58.971811 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:58.972502 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:58.979675 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:58.980121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:58.981354 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:58.981899 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:59.156502 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-73f2f599-d6e3-4eb6-8b08-d391224a92dc tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:59.164929 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-73f2f599-d6e3-4eb6-8b08-d391224a92dc tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.213619 Dec 15 13:36:59.165504 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 57/101] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:58 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:36:59.177880 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:59.186076 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:59.187564 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:59.188657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c019053b-c5f5-4403-a9d1-5a2dc69a3229 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.220579 Dec 15 13:36:59.189225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 45/102] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:36:58 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:36:59.219438 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-83eb66fe-2e25-4860-975b-01a47206385a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:36:59.220147 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-83eb66fe-2e25-4860-975b-01a47206385a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:36:59.226041 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-83eb66fe-2e25-4860-975b-01a47206385a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:59.227092 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-83eb66fe-2e25-4860-975b-01a47206385a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:59.227944 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-83eb66fe-2e25-4860-975b-01a47206385a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:36:59.228476 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-83eb66fe-2e25-4860-975b-01a47206385a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:36:59.365589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-83eb66fe-2e25-4860-975b-01a47206385a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:36:59.374062 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-83eb66fe-2e25-4860-975b-01a47206385a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.158579 Dec 15 13:36:59.374642 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 58/103] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:36:59 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:00.184559 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a7cfb0cd-c44e-4ac6-93c2-51d2e0fd4658 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:00.185172 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a7cfb0cd-c44e-4ac6-93c2-51d2e0fd4658 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:00.191541 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7cfb0cd-c44e-4ac6-93c2-51d2e0fd4658 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:00.191980 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7cfb0cd-c44e-4ac6-93c2-51d2e0fd4658 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:00.192772 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7cfb0cd-c44e-4ac6-93c2-51d2e0fd4658 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:00.193180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7cfb0cd-c44e-4ac6-93c2-51d2e0fd4658 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:00.207345 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:00.207944 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:00.215102 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:00.215537 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:00.216311 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:00.216940 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:00.421025 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a7cfb0cd-c44e-4ac6-93c2-51d2e0fd4658 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:00.429141 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a7cfb0cd-c44e-4ac6-93c2-51d2e0fd4658 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.250979 Dec 15 13:37:00.429788 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 46/104] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:00 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:00.434566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4b8aea96-36a4-4c92-af29-c90bc964a1d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:00.435136 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4b8aea96-36a4-4c92-af29-c90bc964a1d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:00.443210 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4b8aea96-36a4-4c92-af29-c90bc964a1d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:00.443648 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4b8aea96-36a4-4c92-af29-c90bc964a1d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:00.444210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:00.444432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4b8aea96-36a4-4c92-af29-c90bc964a1d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:00.444854 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4b8aea96-36a4-4c92-af29-c90bc964a1d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:00.455090 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:00.456697 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:00.457925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a2ec8a02-2606-4e9d-b9c6-fb7ad192ec40 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.254695 Dec 15 13:37:00.458865 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 59/105] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:00 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:37:00.593640 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4b8aea96-36a4-4c92-af29-c90bc964a1d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:00.604749 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4b8aea96-36a4-4c92-af29-c90bc964a1d8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.170830 Dec 15 13:37:00.604749 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 47/106] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:00 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:01.446963 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-050e6338-b807-4442-b4ae-7518545ec533 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:01.448020 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-050e6338-b807-4442-b4ae-7518545ec533 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:01.454182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-050e6338-b807-4442-b4ae-7518545ec533 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.454714 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-050e6338-b807-4442-b4ae-7518545ec533 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.462100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-050e6338-b807-4442-b4ae-7518545ec533 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.462567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-050e6338-b807-4442-b4ae-7518545ec533 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.477184 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:01.478510 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:01.486093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.486754 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.487568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.488046 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.678857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-050e6338-b807-4442-b4ae-7518545ec533 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:01.690673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:01.690902 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-050e6338-b807-4442-b4ae-7518545ec533 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.247896 Dec 15 13:37:01.691333 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 60/107] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:01 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:01.696705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6bd9702d-ba6d-42fc-98b6-12eb9d4b77e5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:01.697310 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6bd9702d-ba6d-42fc-98b6-12eb9d4b77e5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:01.700763 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:01.704054 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:01.704833 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bd9702d-ba6d-42fc-98b6-12eb9d4b77e5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.705441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bd9702d-ba6d-42fc-98b6-12eb9d4b77e5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.705913 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7efdbef5-82e6-470e-a25e-1e25edb35734 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.233178 Dec 15 13:37:01.706945 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 48/108] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:01 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:37:01.710300 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bd9702d-ba6d-42fc-98b6-12eb9d4b77e5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:01.715357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bd9702d-ba6d-42fc-98b6-12eb9d4b77e5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:01.887670 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6bd9702d-ba6d-42fc-98b6-12eb9d4b77e5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:01.897452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6bd9702d-ba6d-42fc-98b6-12eb9d4b77e5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.205041 Dec 15 13:37:01.902186 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 61/109] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:01 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:02.707523 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7a3b347b-c6a0-4f5e-9520-c560578bf442 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:02.708125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7a3b347b-c6a0-4f5e-9520-c560578bf442 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:02.714169 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7a3b347b-c6a0-4f5e-9520-c560578bf442 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.714614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7a3b347b-c6a0-4f5e-9520-c560578bf442 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.715384 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7a3b347b-c6a0-4f5e-9520-c560578bf442 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.715810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7a3b347b-c6a0-4f5e-9520-c560578bf442 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.726048 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:02.727119 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:02.733729 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.734237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.735007 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.735459 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.909003 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7a3b347b-c6a0-4f5e-9520-c560578bf442 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:02.913249 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:02.916933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7a3b347b-c6a0-4f5e-9520-c560578bf442 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.212984 Dec 15 13:37:02.917497 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 49/110] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:02 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:02.921672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:02.921898 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ff0acea5-7680-4a31-a204-5680fdf07944 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:02.922653 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ff0acea5-7680-4a31-a204-5680fdf07944 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:02.924011 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:02.925306 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-adadfec5-48a8-406e-a33a-3110650ac929 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.203085 Dec 15 13:37:02.925944 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 62/111] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:02 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:37:02.928361 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ff0acea5-7680-4a31-a204-5680fdf07944 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.928804 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ff0acea5-7680-4a31-a204-5680fdf07944 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:02.929572 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ff0acea5-7680-4a31-a204-5680fdf07944 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:02.930021 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ff0acea5-7680-4a31-a204-5680fdf07944 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.055216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ff0acea5-7680-4a31-a204-5680fdf07944 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:03.062312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ff0acea5-7680-4a31-a204-5680fdf07944 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.143858 Dec 15 13:37:03.062866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 50/112] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:02 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:03.934159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-58683810-b53f-4566-8675-a9754d3408b0 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:03.934728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-58683810-b53f-4566-8675-a9754d3408b0 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:03.940539 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-58683810-b53f-4566-8675-a9754d3408b0 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.940977 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-58683810-b53f-4566-8675-a9754d3408b0 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.941777 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-58683810-b53f-4566-8675-a9754d3408b0 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.942273 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-58683810-b53f-4566-8675-a9754d3408b0 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.943070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:03.943668 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:03.950208 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.950646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:03.951405 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:03.951829 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.135690 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-58683810-b53f-4566-8675-a9754d3408b0 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:04.141069 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:04.143471 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-58683810-b53f-4566-8675-a9754d3408b0 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.212914 Dec 15 13:37:04.143972 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 63/113] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:03 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:04.148334 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-145defc5-2104-4d7e-8b46-0aad08f08761 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:04.148957 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-145defc5-2104-4d7e-8b46-0aad08f08761 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:04.150608 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:04.152307 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:04.154182 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-961956ca-0c9f-4eae-b0ef-43b7560cc24d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.214175 Dec 15 13:37:04.154934 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-145defc5-2104-4d7e-8b46-0aad08f08761 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.155360 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 51/114] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:03 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:37:04.165874 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-145defc5-2104-4d7e-8b46-0aad08f08761 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.167035 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-145defc5-2104-4d7e-8b46-0aad08f08761 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.167479 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-145defc5-2104-4d7e-8b46-0aad08f08761 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.310817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-145defc5-2104-4d7e-8b46-0aad08f08761 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:04.319253 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-145defc5-2104-4d7e-8b46-0aad08f08761 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.174137 Dec 15 13:37:04.319829 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 64/115] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:04 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:04.613617 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-598f1a9b-db79-4901-a4e4-4d3d66b86fec req-06aaad92-a63b-4b07-8112-664d9c7ee019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53bb255-30a9-4c8c-b637-c9f371b04944", "name": "network-vif-plugged", "status": "completed", "tag": "ba9131b0-fdf7-4ed2-a8c9-1c6801656498"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:04.615909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:04.615909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:37:04.626378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-598f1a9b-db79-4901-a4e4-4d3d66b86fec req-06aaad92-a63b-4b07-8112-664d9c7ee019 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.626821 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-598f1a9b-db79-4901-a4e4-4d3d66b86fec req-06aaad92-a63b-4b07-8112-664d9c7ee019 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.646274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-598f1a9b-db79-4901-a4e4-4d3d66b86fec req-06aaad92-a63b-4b07-8112-664d9c7ee019 service nova] Creating event network-vif-plugged:ba9131b0-fdf7-4ed2-a8c9-1c6801656498 for instance f53bb255-30a9-4c8c-b637-c9f371b04944 on hv-cinder-81322 Dec 15 13:37:04.646807 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-598f1a9b-db79-4901-a4e4-4d3d66b86fec req-06aaad92-a63b-4b07-8112-664d9c7ee019 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 13:37:04.647911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7e5667a-075c-4abf-bd1e-fe1965b0aac5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.648901 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7e5667a-075c-4abf-bd1e-fe1965b0aac5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.649693 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7e5667a-075c-4abf-bd1e-fe1965b0aac5 None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:04.650142 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7e5667a-075c-4abf-bd1e-fe1965b0aac5 None None] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:04.659115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.compute.rpcapi [None req-d7e5667a-075c-4abf-bd1e-fe1965b0aac5 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 13:37:04.659990 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7e5667a-075c-4abf-bd1e-fe1965b0aac5 None None] Releasing lock "compute-rpcapi-router" {{(pid=122612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 13:37:04.684767 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d7e5667a-075c-4abf-bd1e-fe1965b0aac5 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130193 Dec 15 13:37:04.685582 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 52/116] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:05.160593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-bdcb601a-fa0c-4721-8908-3bcff879e7c1 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:05.161511 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-bdcb601a-fa0c-4721-8908-3bcff879e7c1 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:05.167452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bdcb601a-fa0c-4721-8908-3bcff879e7c1 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.167991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bdcb601a-fa0c-4721-8908-3bcff879e7c1 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.168841 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bdcb601a-fa0c-4721-8908-3bcff879e7c1 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.169483 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bdcb601a-fa0c-4721-8908-3bcff879e7c1 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.178974 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:05.181402 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:05.194689 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.196268 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.198049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.199283 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.359361 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-bdcb601a-fa0c-4721-8908-3bcff879e7c1 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:05.368271 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-bdcb601a-fa0c-4721-8908-3bcff879e7c1 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.211319 Dec 15 13:37:05.368932 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 65/117] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:05 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:05.374165 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d73182bf-510e-42ab-88c5-141b203cdbb1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:05.374999 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d73182bf-510e-42ab-88c5-141b203cdbb1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:05.381558 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d73182bf-510e-42ab-88c5-141b203cdbb1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.382036 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d73182bf-510e-42ab-88c5-141b203cdbb1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.383584 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d73182bf-510e-42ab-88c5-141b203cdbb1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:05.383886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d73182bf-510e-42ab-88c5-141b203cdbb1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:05.397222 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:05.406639 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:05.408427 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:05.409535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ba79f465-5905-4dda-b62d-c9e8e424bbdd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.239222 Dec 15 13:37:05.419958 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 53/118] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:05 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:37:05.524288 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d73182bf-510e-42ab-88c5-141b203cdbb1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:05.535274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d73182bf-510e-42ab-88c5-141b203cdbb1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.164681 Dec 15 13:37:05.535912 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 66/119] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:05 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:06.384696 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-957f1436-c13e-47fc-bbeb-f75dca4c967b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:06.385296 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-957f1436-c13e-47fc-bbeb-f75dca4c967b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:06.397453 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-957f1436-c13e-47fc-bbeb-f75dca4c967b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.398059 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-957f1436-c13e-47fc-bbeb-f75dca4c967b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.399300 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-957f1436-c13e-47fc-bbeb-f75dca4c967b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.399736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-957f1436-c13e-47fc-bbeb-f75dca4c967b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.427745 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:06.429187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:06.447567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.448057 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.449091 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.452107 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.638159 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-957f1436-c13e-47fc-bbeb-f75dca4c967b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:06.652810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-957f1436-c13e-47fc-bbeb-f75dca4c967b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.272147 Dec 15 13:37:06.655541 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 54/120] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:06 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:06.679362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a221f4c2-092e-43a9-9796-2aab83964c83 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:06.679921 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a221f4c2-092e-43a9-9796-2aab83964c83 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:06.691050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a221f4c2-092e-43a9-9796-2aab83964c83 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.691050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a221f4c2-092e-43a9-9796-2aab83964c83 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.691735 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a221f4c2-092e-43a9-9796-2aab83964c83 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.692362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a221f4c2-092e-43a9-9796-2aab83964c83 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.697282 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:06.705621 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:06.707159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:06.708412 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b8319d3a-2638-4e11-a4fe-16a03b588b95 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.285402 Dec 15 13:37:06.708957 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 67/121] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:06 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:37:06.714394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-38b15b48-32bf-4f7b-9f76-de165e2afd1d req-3a1935a5-7998-4145-9a8a-25008b8ba8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bee9b6-80cd-4147-b4a8-5919d331342e", "name": "network-vif-plugged", "status": "completed", "tag": "b2a560ce-9e8c-40f7-9de3-fc3410722da3"}, {"server_uuid": "5f740a90-17ff-49e3-8f5d-f1450ae6baf0", "name": "network-vif-plugged", "status": "completed", "tag": "8265af4f-8d5b-423a-84c5-273348379f9f"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:06.716111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:06.716111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:37:06.725373 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-38b15b48-32bf-4f7b-9f76-de165e2afd1d req-3a1935a5-7998-4145-9a8a-25008b8ba8e8 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:06.725932 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-38b15b48-32bf-4f7b-9f76-de165e2afd1d req-3a1935a5-7998-4145-9a8a-25008b8ba8e8 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:06.739403 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-38b15b48-32bf-4f7b-9f76-de165e2afd1d req-3a1935a5-7998-4145-9a8a-25008b8ba8e8 service nova] Creating event network-vif-plugged:b2a560ce-9e8c-40f7-9de3-fc3410722da3 for instance 06bee9b6-80cd-4147-b4a8-5919d331342e on hv-cinder-81322 Dec 15 13:37:06.739905 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-38b15b48-32bf-4f7b-9f76-de165e2afd1d req-3a1935a5-7998-4145-9a8a-25008b8ba8e8 service nova] Creating event network-vif-plugged:8265af4f-8d5b-423a-84c5-273348379f9f for instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 on hv-cinder-81322 Dec 15 13:37:06.746556 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-38b15b48-32bf-4f7b-9f76-de165e2afd1d req-3a1935a5-7998-4145-9a8a-25008b8ba8e8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036359 Dec 15 13:37:06.747515 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 68/122] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:06 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:06.908907 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a221f4c2-092e-43a9-9796-2aab83964c83 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:06.917408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a221f4c2-092e-43a9-9796-2aab83964c83 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.256966 Dec 15 13:37:06.918631 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 55/123] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:06 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:07.671737 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-205179a8-a6b6-448d-bad2-6106e7386868 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:07.672531 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-205179a8-a6b6-448d-bad2-6106e7386868 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:07.679020 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-205179a8-a6b6-448d-bad2-6106e7386868 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:07.680119 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-205179a8-a6b6-448d-bad2-6106e7386868 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:07.680917 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-205179a8-a6b6-448d-bad2-6106e7386868 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:07.681413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-205179a8-a6b6-448d-bad2-6106e7386868 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:07.733055 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:07.734497 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:07.744446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:07.744943 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:07.745740 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:07.746260 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:07.859183 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-205179a8-a6b6-448d-bad2-6106e7386868 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:07.870973 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-205179a8-a6b6-448d-bad2-6106e7386868 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.203181 Dec 15 13:37:07.871613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 69/124] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:07 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:07.936187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e3f9abad-aaef-430e-af70-346781a36d4c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:07.937045 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e3f9abad-aaef-430e-af70-346781a36d4c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:07.952528 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e3f9abad-aaef-430e-af70-346781a36d4c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:07.954366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e3f9abad-aaef-430e-af70-346781a36d4c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:07.955190 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e3f9abad-aaef-430e-af70-346781a36d4c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:07.955642 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e3f9abad-aaef-430e-af70-346781a36d4c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:07.957255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:07.973529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:07.977142 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:07.978659 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c0af6cae-36d6-4118-95b3-b1545a1ae90d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.255866 Dec 15 13:37:07.979663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 56/125] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:07 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:37:08.161951 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e3f9abad-aaef-430e-af70-346781a36d4c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:08.173032 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e3f9abad-aaef-430e-af70-346781a36d4c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.242364 Dec 15 13:37:08.174317 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 70/126] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:07 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:08.762342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-c7ef9044-58d2-4611-843e-b7c114bc5609 req-b96d0995-b6d5-4c1d-8826-017a7c60d1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16af4c97-7ce7-47dd-8493-24d19a46221d", "name": "network-vif-plugged", "status": "completed", "tag": "e4b8c97b-020a-4806-8f09-f876ba55ad9d"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:08.763933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:08.763933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:37:08.770688 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-c7ef9044-58d2-4611-843e-b7c114bc5609 req-b96d0995-b6d5-4c1d-8826-017a7c60d1be service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:08.771118 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-c7ef9044-58d2-4611-843e-b7c114bc5609 req-b96d0995-b6d5-4c1d-8826-017a7c60d1be service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:08.783225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-c7ef9044-58d2-4611-843e-b7c114bc5609 req-b96d0995-b6d5-4c1d-8826-017a7c60d1be service nova] Creating event network-vif-plugged:e4b8c97b-020a-4806-8f09-f876ba55ad9d for instance 16af4c97-7ce7-47dd-8493-24d19a46221d on hv-cinder-81322 Dec 15 13:37:08.788522 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-c7ef9044-58d2-4611-843e-b7c114bc5609 req-b96d0995-b6d5-4c1d-8826-017a7c60d1be service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029739 Dec 15 13:37:08.792591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 57/127] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:08.888280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0cc5d8e2-01a7-41b9-be31-6f90b365c109 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:08.888877 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0cc5d8e2-01a7-41b9-be31-6f90b365c109 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:08.894587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8e2-01a7-41b9-be31-6f90b365c109 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:08.895029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8e2-01a7-41b9-be31-6f90b365c109 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:08.895776 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8e2-01a7-41b9-be31-6f90b365c109 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:08.896199 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0cc5d8e2-01a7-41b9-be31-6f90b365c109 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:08.997801 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:08.998586 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:09.004717 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.005160 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:09.005966 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.006393 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:09.032304 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0cc5d8e2-01a7-41b9-be31-6f90b365c109 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:09.040159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0cc5d8e2-01a7-41b9-be31-6f90b365c109 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.155357 Dec 15 13:37:09.040736 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 71/128] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:08 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:09.146220 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:09.154676 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:09.156157 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:09.157264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6b48d8d4-2af4-4f2d-9a23-a33047e25e70 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.163519 Dec 15 13:37:09.157828 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 58/129] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:08 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:37:09.191059 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2dc57da5-7938-456d-836e-3202ba7f0d3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:09.191536 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2dc57da5-7938-456d-836e-3202ba7f0d3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:09.198197 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2dc57da5-7938-456d-836e-3202ba7f0d3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.198995 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2dc57da5-7938-456d-836e-3202ba7f0d3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:09.199687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2dc57da5-7938-456d-836e-3202ba7f0d3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:09.206687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2dc57da5-7938-456d-836e-3202ba7f0d3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:09.350457 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2dc57da5-7938-456d-836e-3202ba7f0d3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:09.358335 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2dc57da5-7938-456d-836e-3202ba7f0d3c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.171389 Dec 15 13:37:09.358836 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 72/130] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:09 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:10.056324 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2ba686a4-84ee-4224-8e50-7a9604c79421 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:10.057074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2ba686a4-84ee-4224-8e50-7a9604c79421 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:10.062812 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2ba686a4-84ee-4224-8e50-7a9604c79421 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.063322 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2ba686a4-84ee-4224-8e50-7a9604c79421 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.064168 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2ba686a4-84ee-4224-8e50-7a9604c79421 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.064658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2ba686a4-84ee-4224-8e50-7a9604c79421 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.180861 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:10.181483 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:10.188715 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.189166 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.190282 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.190514 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.210213 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2ba686a4-84ee-4224-8e50-7a9604c79421 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:10.219579 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2ba686a4-84ee-4224-8e50-7a9604c79421 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.167041 Dec 15 13:37:10.220613 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 59/131] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:10 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:10.381634 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-64416824-c9b3-45a4-8854-e9de600dc7dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:10.382547 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-64416824-c9b3-45a4-8854-e9de600dc7dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:10.390420 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-64416824-c9b3-45a4-8854-e9de600dc7dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.391351 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-64416824-c9b3-45a4-8854-e9de600dc7dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.392356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-64416824-c9b3-45a4-8854-e9de600dc7dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:10.392996 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-64416824-c9b3-45a4-8854-e9de600dc7dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:10.622486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:10.640584 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:10.642388 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:10.643715 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-38894e42-67c1-4d8a-bcb9-818955687537 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.468466 Dec 15 13:37:10.644424 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 73/132] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:10 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:37:10.712745 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-64416824-c9b3-45a4-8854-e9de600dc7dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:10.720119 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-64416824-c9b3-45a4-8854-e9de600dc7dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.342445 Dec 15 13:37:10.720676 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 60/133] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:10 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:11.236912 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-461746e4-b4d2-4e80-9290-c12c029f073b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:11.237614 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-461746e4-b4d2-4e80-9290-c12c029f073b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:11.244781 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-461746e4-b4d2-4e80-9290-c12c029f073b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:11.245373 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-461746e4-b4d2-4e80-9290-c12c029f073b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:11.246391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-461746e4-b4d2-4e80-9290-c12c029f073b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:11.246967 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-461746e4-b4d2-4e80-9290-c12c029f073b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:11.451040 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-461746e4-b4d2-4e80-9290-c12c029f073b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:11.468178 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-461746e4-b4d2-4e80-9290-c12c029f073b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1315 microversion: 2.1 time: 0.235229 Dec 15 13:37:11.468808 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 74/134] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:11 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:11.665975 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:11.666813 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:11.675404 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:11.676036 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:11.677074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:11.678344 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:11.738883 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1896c2bc-51da-47bd-9538-14c403e9a65c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:11.739501 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1896c2bc-51da-47bd-9538-14c403e9a65c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:11.751031 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1896c2bc-51da-47bd-9538-14c403e9a65c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:11.751475 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1896c2bc-51da-47bd-9538-14c403e9a65c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:11.752298 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1896c2bc-51da-47bd-9538-14c403e9a65c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:11.752694 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1896c2bc-51da-47bd-9538-14c403e9a65c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:11.944396 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:11.955947 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:11.958161 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:11.959217 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cef5dde6-82e5-46ed-b1e1-d54650b8ac2c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1406 microversion: 2.20 time: 0.299057 Dec 15 13:37:11.959777 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 61/135] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:11 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:37:11.992077 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1896c2bc-51da-47bd-9538-14c403e9a65c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:12.001448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1896c2bc-51da-47bd-9538-14c403e9a65c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1321 microversion: 2.1 time: 0.267266 Dec 15 13:37:12.002375 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 75/136] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:11 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:12.485269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b72653a6-7545-4f79-84bc-38e71786dbcf tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:12.485977 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b72653a6-7545-4f79-84bc-38e71786dbcf tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:12.495743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b72653a6-7545-4f79-84bc-38e71786dbcf tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:12.495743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b72653a6-7545-4f79-84bc-38e71786dbcf tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:12.495743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b72653a6-7545-4f79-84bc-38e71786dbcf tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:12.495743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b72653a6-7545-4f79-84bc-38e71786dbcf tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:12.631921 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b72653a6-7545-4f79-84bc-38e71786dbcf tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:12.639794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b72653a6-7545-4f79-84bc-38e71786dbcf tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1503 microversion: 2.1 time: 0.158114 Dec 15 13:37:12.640599 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 62/137] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:12 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:12.980007 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:12.980652 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:12.989802 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:12.990254 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:12.991032 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:12.992746 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.018766 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9a51e8a0-8e31-49b6-a802-229da8b0a106 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:13.019374 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9a51e8a0-8e31-49b6-a802-229da8b0a106 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:13.027969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a51e8a0-8e31-49b6-a802-229da8b0a106 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.031548 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a51e8a0-8e31-49b6-a802-229da8b0a106 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.032455 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a51e8a0-8e31-49b6-a802-229da8b0a106 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.032999 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a51e8a0-8e31-49b6-a802-229da8b0a106 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.289648 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:13.299552 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:13.306644 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:13.307960 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9787560f-808e-42ee-9d02-1cf3636eb1f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1598 microversion: 2.20 time: 0.332387 Dec 15 13:37:13.310599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 76/138] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:37:12 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1598 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:37:13.327768 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9a51e8a0-8e31-49b6-a802-229da8b0a106 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:13.327935 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3483be5f-b704-4b91-9c8b-76a7f027e465 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:13.328299 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3483be5f-b704-4b91-9c8b-76a7f027e465 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:13.334855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3483be5f-b704-4b91-9c8b-76a7f027e465 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.335523 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3483be5f-b704-4b91-9c8b-76a7f027e465 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.337174 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9a51e8a0-8e31-49b6-a802-229da8b0a106 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1516 microversion: 2.1 time: 0.321779 Dec 15 13:37:13.337502 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3483be5f-b704-4b91-9c8b-76a7f027e465 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.338096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3483be5f-b704-4b91-9c8b-76a7f027e465 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.338420 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 63/139] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:13 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:13.354610 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8b7965b2-7c2d-4ee6-be19-b55f0e276b69 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:13.355637 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8b7965b2-7c2d-4ee6-be19-b55f0e276b69 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:13.389266 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8b7965b2-7c2d-4ee6-be19-b55f0e276b69 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.392529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8b7965b2-7c2d-4ee6-be19-b55f0e276b69 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.393636 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8b7965b2-7c2d-4ee6-be19-b55f0e276b69 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.394614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8b7965b2-7c2d-4ee6-be19-b55f0e276b69 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.521357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3483be5f-b704-4b91-9c8b-76a7f027e465 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.197564 Dec 15 13:37:13.522083 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 77/140] 10.222.0.83 () {60 vars in 1315 bytes} [Wed Dec 15 13:37:13 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:37:13.537777 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-8b7965b2-7c2d-4ee6-be19-b55f0e276b69 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'flavor' on Instance uuid 06bee9b6-80cd-4147-b4a8-5919d331342e {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:37:13.671774 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8b7965b2-7c2d-4ee6-be19-b55f0e276b69 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e/action" status: 200 len: 32 microversion: 2.1 time: 0.321368 Dec 15 13:37:13.672712 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 64/141] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:37:13 2021] POST /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e/action => generated 32 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:37:13.681185 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a2c27c3f-bf6c-4c01-aec3-936d1d5aab03 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:13.681836 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a2c27c3f-bf6c-4c01-aec3-936d1d5aab03 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:13.691429 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2c27c3f-bf6c-4c01-aec3-936d1d5aab03 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.691838 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2c27c3f-bf6c-4c01-aec3-936d1d5aab03 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.692598 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2c27c3f-bf6c-4c01-aec3-936d1d5aab03 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:13.692989 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2c27c3f-bf6c-4c01-aec3-936d1d5aab03 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:13.868351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a2c27c3f-bf6c-4c01-aec3-936d1d5aab03 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:13.876187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a2c27c3f-bf6c-4c01-aec3-936d1d5aab03 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.198602 Dec 15 13:37:13.876754 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 78/142] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:13 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:14.900563 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f3b7ecac-7bb5-4c11-9e50-27ee64b47f45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:14.901450 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f3b7ecac-7bb5-4c11-9e50-27ee64b47f45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:14.907952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3b7ecac-7bb5-4c11-9e50-27ee64b47f45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:14.908434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3b7ecac-7bb5-4c11-9e50-27ee64b47f45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:14.909220 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3b7ecac-7bb5-4c11-9e50-27ee64b47f45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:14.909649 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3b7ecac-7bb5-4c11-9e50-27ee64b47f45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:15.107946 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f3b7ecac-7bb5-4c11-9e50-27ee64b47f45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:15.117801 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f75e949b-52dd-439d-9ea2-193640c1b6df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:15.119737 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f75e949b-52dd-439d-9ea2-193640c1b6df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:15.130467 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f75e949b-52dd-439d-9ea2-193640c1b6df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:15.131022 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f75e949b-52dd-439d-9ea2-193640c1b6df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:15.131549 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f3b7ecac-7bb5-4c11-9e50-27ee64b47f45 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.241095 Dec 15 13:37:15.132436 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 65/143] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:14 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:15.132572 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f75e949b-52dd-439d-9ea2-193640c1b6df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:15.138993 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-3355b90e-3513-46dd-bc3f-78ff54e00519 req-8b5b1f76-029a-4e94-abe5-3a0e92f8ff4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16af4c97-7ce7-47dd-8493-24d19a46221d", "tag": "e4b8c97b-020a-4806-8f09-f876ba55ad9d"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:15.140491 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:15.140491 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:37:15.143951 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f75e949b-52dd-439d-9ea2-193640c1b6df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:15.151613 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-3355b90e-3513-46dd-bc3f-78ff54e00519 req-8b5b1f76-029a-4e94-abe5-3a0e92f8ff4c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:15.152245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-3355b90e-3513-46dd-bc3f-78ff54e00519 req-8b5b1f76-029a-4e94-abe5-3a0e92f8ff4c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:15.167615 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-3355b90e-3513-46dd-bc3f-78ff54e00519 req-8b5b1f76-029a-4e94-abe5-3a0e92f8ff4c service nova] Creating event network-changed:e4b8c97b-020a-4806-8f09-f876ba55ad9d for instance 16af4c97-7ce7-47dd-8493-24d19a46221d on hv-cinder-81322 Dec 15 13:37:15.175591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-3355b90e-3513-46dd-bc3f-78ff54e00519 req-8b5b1f76-029a-4e94-abe5-3a0e92f8ff4c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039737 Dec 15 13:37:15.185387 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 66/144] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:15.581209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f75e949b-52dd-439d-9ea2-193640c1b6df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 14 microversion: 2.20 time: 0.469254 Dec 15 13:37:15.587207 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 79/145] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:15 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 14 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:16.150873 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-03323209-5a27-47ea-ad96-e592ca9dd3e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:16.151592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-03323209-5a27-47ea-ad96-e592ca9dd3e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:16.165661 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-03323209-5a27-47ea-ad96-e592ca9dd3e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:16.166203 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-03323209-5a27-47ea-ad96-e592ca9dd3e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:16.168628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-03323209-5a27-47ea-ad96-e592ca9dd3e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:16.170045 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-03323209-5a27-47ea-ad96-e592ca9dd3e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:16.240809 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-eb7b92a6-eabd-4ea4-9b57-376602e9a5ed tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e809190d-f71f-4eb1-98b8-09c1a7da8973"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:16.243271 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-eb7b92a6-eabd-4ea4-9b57-376602e9a5ed tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:16.256140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eb7b92a6-eabd-4ea4-9b57-376602e9a5ed tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:16.262188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eb7b92a6-eabd-4ea4-9b57-376602e9a5ed tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:16.263221 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eb7b92a6-eabd-4ea4-9b57-376602e9a5ed tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:16.263764 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eb7b92a6-eabd-4ea4-9b57-376602e9a5ed tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:16.554910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-03323209-5a27-47ea-ad96-e592ca9dd3e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:16.567841 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-03323209-5a27-47ea-ad96-e592ca9dd3e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.421488 Dec 15 13:37:16.568855 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 67/146] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:16 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:16.598663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e816a7c7-554e-4eff-919c-eedfb0c86f55 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:16.599709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e816a7c7-554e-4eff-919c-eedfb0c86f55 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:16.609447 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e816a7c7-554e-4eff-919c-eedfb0c86f55 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:16.611316 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e816a7c7-554e-4eff-919c-eedfb0c86f55 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:16.613183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e816a7c7-554e-4eff-919c-eedfb0c86f55 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:16.614872 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e816a7c7-554e-4eff-919c-eedfb0c86f55 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:16.723511 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e816a7c7-554e-4eff-919c-eedfb0c86f55 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 14 microversion: 2.20 time: 0.128834 Dec 15 13:37:16.724883 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 68/147] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:16 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:16.798908 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-eb7b92a6-eabd-4ea4-9b57-376602e9a5ed tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "POST /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562364 Dec 15 13:37:16.803396 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 80/148] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:37:16 2021] POST /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0/os-volume_attachments => generated 194 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:37:17.587867 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5323d649-c4a5-4cd7-acef-8d091c196423 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:17.588716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5323d649-c4a5-4cd7-acef-8d091c196423 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:17.596485 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5323d649-c4a5-4cd7-acef-8d091c196423 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:17.597490 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5323d649-c4a5-4cd7-acef-8d091c196423 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:17.598783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5323d649-c4a5-4cd7-acef-8d091c196423 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:17.599371 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5323d649-c4a5-4cd7-acef-8d091c196423 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:17.736836 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e88b338f-3e14-4d19-a16a-4c48ec428f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:17.737849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e88b338f-3e14-4d19-a16a-4c48ec428f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:17.744476 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e88b338f-3e14-4d19-a16a-4c48ec428f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:17.744927 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e88b338f-3e14-4d19-a16a-4c48ec428f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:17.745705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e88b338f-3e14-4d19-a16a-4c48ec428f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:17.745912 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5323d649-c4a5-4cd7-acef-8d091c196423 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:17.746194 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e88b338f-3e14-4d19-a16a-4c48ec428f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:17.753483 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5323d649-c4a5-4cd7-acef-8d091c196423 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.170887 Dec 15 13:37:17.754163 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 69/149] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:17 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:18.770576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-33bce2b7-1a2d-4e11-93fd-8411fac3f819 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:18.771203 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-33bce2b7-1a2d-4e11-93fd-8411fac3f819 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:18.777439 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-33bce2b7-1a2d-4e11-93fd-8411fac3f819 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:18.777927 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-33bce2b7-1a2d-4e11-93fd-8411fac3f819 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:18.778688 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-33bce2b7-1a2d-4e11-93fd-8411fac3f819 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:18.779113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-33bce2b7-1a2d-4e11-93fd-8411fac3f819 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:18.905049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-33bce2b7-1a2d-4e11-93fd-8411fac3f819 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:18.912200 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-33bce2b7-1a2d-4e11-93fd-8411fac3f819 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.145208 Dec 15 13:37:18.912766 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 70/150] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:18 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:19.928275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-78e8a26b-943d-4708-ac4e-1012d0d09716 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:19.928871 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-78e8a26b-943d-4708-ac4e-1012d0d09716 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:19.935887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-78e8a26b-943d-4708-ac4e-1012d0d09716 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:19.936333 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-78e8a26b-943d-4708-ac4e-1012d0d09716 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:19.937113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-78e8a26b-943d-4708-ac4e-1012d0d09716 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:19.937547 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-78e8a26b-943d-4708-ac4e-1012d0d09716 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:20.084446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-78e8a26b-943d-4708-ac4e-1012d0d09716 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:20.092526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-78e8a26b-943d-4708-ac4e-1012d0d09716 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.167937 Dec 15 13:37:20.093097 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 71/151] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:19 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:20.353066 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e88b338f-3e14-4d19-a16a-4c48ec428f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 14 microversion: 2.20 time: 2.619346 Dec 15 13:37:20.353744 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 81/152] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:17 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 14 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:21.108611 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e3e44594-45ce-40f7-b85b-9b4a30be6811 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:21.109207 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e3e44594-45ce-40f7-b85b-9b4a30be6811 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:21.115371 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3e44594-45ce-40f7-b85b-9b4a30be6811 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:21.115808 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3e44594-45ce-40f7-b85b-9b4a30be6811 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:21.116601 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3e44594-45ce-40f7-b85b-9b4a30be6811 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:21.117564 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3e44594-45ce-40f7-b85b-9b4a30be6811 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:21.253708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e3e44594-45ce-40f7-b85b-9b4a30be6811 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:21.261229 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e3e44594-45ce-40f7-b85b-9b4a30be6811 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.156144 Dec 15 13:37:21.261814 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 72/153] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:21 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:21.364406 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ba17bd09-842c-4cd0-9156-7869a3941ac3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:21.365371 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ba17bd09-842c-4cd0-9156-7869a3941ac3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:21.372622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ba17bd09-842c-4cd0-9156-7869a3941ac3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:21.373059 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ba17bd09-842c-4cd0-9156-7869a3941ac3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:21.373835 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ba17bd09-842c-4cd0-9156-7869a3941ac3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:21.374261 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ba17bd09-842c-4cd0-9156-7869a3941ac3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:22.277227 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d7cf8722-8839-4bbd-9e26-1881fa0e0450 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:22.277846 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d7cf8722-8839-4bbd-9e26-1881fa0e0450 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:22.284035 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7cf8722-8839-4bbd-9e26-1881fa0e0450 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:22.284473 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7cf8722-8839-4bbd-9e26-1881fa0e0450 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:22.285227 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7cf8722-8839-4bbd-9e26-1881fa0e0450 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:22.285656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7cf8722-8839-4bbd-9e26-1881fa0e0450 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:22.416966 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d7cf8722-8839-4bbd-9e26-1881fa0e0450 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:22.424148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d7cf8722-8839-4bbd-9e26-1881fa0e0450 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.150515 Dec 15 13:37:22.424734 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 73/154] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:22 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:23.440631 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-78483bb2-e33d-4362-bf94-58e094ff6a9f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:23.441240 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-78483bb2-e33d-4362-bf94-58e094ff6a9f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:23.448253 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-78483bb2-e33d-4362-bf94-58e094ff6a9f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:23.448642 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-78483bb2-e33d-4362-bf94-58e094ff6a9f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:23.449663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-78483bb2-e33d-4362-bf94-58e094ff6a9f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:23.450122 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-78483bb2-e33d-4362-bf94-58e094ff6a9f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:23.586115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-78483bb2-e33d-4362-bf94-58e094ff6a9f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:23.593255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-78483bb2-e33d-4362-bf94-58e094ff6a9f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.156275 Dec 15 13:37:23.593840 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 74/155] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:23 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:23.850890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ba17bd09-842c-4cd0-9156-7869a3941ac3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 14 microversion: 2.20 time: 2.490298 Dec 15 13:37:23.852287 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 82/156] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:21 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 14 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:24.610592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d691c722-2a0d-4ced-8f4f-07a766b03ba3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:24.611336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d691c722-2a0d-4ced-8f4f-07a766b03ba3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:24.618043 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d691c722-2a0d-4ced-8f4f-07a766b03ba3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:24.618483 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d691c722-2a0d-4ced-8f4f-07a766b03ba3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:24.619245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d691c722-2a0d-4ced-8f4f-07a766b03ba3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:24.619667 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d691c722-2a0d-4ced-8f4f-07a766b03ba3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:24.750269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d691c722-2a0d-4ced-8f4f-07a766b03ba3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:24.758220 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d691c722-2a0d-4ced-8f4f-07a766b03ba3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.150577 Dec 15 13:37:24.758794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 75/157] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:24 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:24.863121 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3598c6da-9a98-443c-a234-b0a5849a84f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:24.864137 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3598c6da-9a98-443c-a234-b0a5849a84f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:24.872451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3598c6da-9a98-443c-a234-b0a5849a84f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:24.872895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3598c6da-9a98-443c-a234-b0a5849a84f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:24.873672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3598c6da-9a98-443c-a234-b0a5849a84f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:24.874144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3598c6da-9a98-443c-a234-b0a5849a84f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:25.776495 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8c09dfaf-478e-4bf2-afa3-2ecc90806d62 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:25.777093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8c09dfaf-478e-4bf2-afa3-2ecc90806d62 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:25.783311 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8c09dfaf-478e-4bf2-afa3-2ecc90806d62 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:25.783732 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8c09dfaf-478e-4bf2-afa3-2ecc90806d62 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:25.784484 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8c09dfaf-478e-4bf2-afa3-2ecc90806d62 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:25.784905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8c09dfaf-478e-4bf2-afa3-2ecc90806d62 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:25.914752 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8c09dfaf-478e-4bf2-afa3-2ecc90806d62 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:25.921826 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8c09dfaf-478e-4bf2-afa3-2ecc90806d62 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.149591 Dec 15 13:37:25.922388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 76/158] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:25 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:26.938701 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2e4ef365-eef4-4e7b-ab8f-9bde8ba9be7b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:26.939324 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2e4ef365-eef4-4e7b-ab8f-9bde8ba9be7b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:26.945448 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2e4ef365-eef4-4e7b-ab8f-9bde8ba9be7b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:26.945932 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2e4ef365-eef4-4e7b-ab8f-9bde8ba9be7b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:26.946704 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2e4ef365-eef4-4e7b-ab8f-9bde8ba9be7b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:26.947190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2e4ef365-eef4-4e7b-ab8f-9bde8ba9be7b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:27.073720 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2e4ef365-eef4-4e7b-ab8f-9bde8ba9be7b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:27.081151 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2e4ef365-eef4-4e7b-ab8f-9bde8ba9be7b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.146239 Dec 15 13:37:27.081732 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 77/159] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:26 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:27.159606 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3598c6da-9a98-443c-a234-b0a5849a84f8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 14 microversion: 2.20 time: 2.300702 Dec 15 13:37:27.160266 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 83/160] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:24 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 14 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:28.098567 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0c321cbe-1758-4bce-92bf-b47481eb9dbf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:28.099263 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0c321cbe-1758-4bce-92bf-b47481eb9dbf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:28.105922 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c321cbe-1758-4bce-92bf-b47481eb9dbf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:28.106456 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c321cbe-1758-4bce-92bf-b47481eb9dbf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:28.107409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c321cbe-1758-4bce-92bf-b47481eb9dbf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:28.107920 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c321cbe-1758-4bce-92bf-b47481eb9dbf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:28.171302 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-244890ce-97e8-48c2-a2db-c64e8f37188d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:28.172384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-244890ce-97e8-48c2-a2db-c64e8f37188d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:28.181490 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-244890ce-97e8-48c2-a2db-c64e8f37188d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:28.182055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-244890ce-97e8-48c2-a2db-c64e8f37188d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:28.183140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-244890ce-97e8-48c2-a2db-c64e8f37188d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:28.183633 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-244890ce-97e8-48c2-a2db-c64e8f37188d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:28.264519 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-244890ce-97e8-48c2-a2db-c64e8f37188d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 14 microversion: 2.20 time: 0.097118 Dec 15 13:37:28.266488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 84/161] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:28 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:28.269124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0c321cbe-1758-4bce-92bf-b47481eb9dbf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:28.283235 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0c321cbe-1758-4bce-92bf-b47481eb9dbf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.188740 Dec 15 13:37:28.284081 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 78/162] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:28 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:29.276700 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c16bdaeb-e6c6-4d55-8355-019fec2495c0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:29.277683 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c16bdaeb-e6c6-4d55-8355-019fec2495c0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:29.284494 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c16bdaeb-e6c6-4d55-8355-019fec2495c0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:29.284937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c16bdaeb-e6c6-4d55-8355-019fec2495c0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:29.285694 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c16bdaeb-e6c6-4d55-8355-019fec2495c0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:29.286145 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c16bdaeb-e6c6-4d55-8355-019fec2495c0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:29.300006 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-47a9c183-88ed-41ba-9fd0-59023602f1b4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:29.300594 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-47a9c183-88ed-41ba-9fd0-59023602f1b4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:29.306889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-47a9c183-88ed-41ba-9fd0-59023602f1b4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:29.307399 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-47a9c183-88ed-41ba-9fd0-59023602f1b4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:29.308366 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-47a9c183-88ed-41ba-9fd0-59023602f1b4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:29.308882 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-47a9c183-88ed-41ba-9fd0-59023602f1b4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:29.453748 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-47a9c183-88ed-41ba-9fd0-59023602f1b4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:29.461452 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-47a9c183-88ed-41ba-9fd0-59023602f1b4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.164536 Dec 15 13:37:29.462274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 79/163] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:29 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:30.478997 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f5e7c1ff-c778-4554-9fee-d69240248266 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:30.479807 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f5e7c1ff-c778-4554-9fee-d69240248266 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:30.486527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5e7c1ff-c778-4554-9fee-d69240248266 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:30.486947 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5e7c1ff-c778-4554-9fee-d69240248266 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:30.487744 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5e7c1ff-c778-4554-9fee-d69240248266 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:30.488152 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5e7c1ff-c778-4554-9fee-d69240248266 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:30.620083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f5e7c1ff-c778-4554-9fee-d69240248266 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:30.628274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f5e7c1ff-c778-4554-9fee-d69240248266 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.153495 Dec 15 13:37:30.637789 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 80/164] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:30 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:31.541640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c16bdaeb-e6c6-4d55-8355-019fec2495c0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 14203 microversion: 2.20 time: 2.269264 Dec 15 13:37:31.543399 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 85/165] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:29 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 14203 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:31.643877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f16964fc-48d8-46a2-92f0-75d1f638c0a9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:31.644483 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f16964fc-48d8-46a2-92f0-75d1f638c0a9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:31.651179 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f16964fc-48d8-46a2-92f0-75d1f638c0a9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:31.651631 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f16964fc-48d8-46a2-92f0-75d1f638c0a9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:31.652405 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f16964fc-48d8-46a2-92f0-75d1f638c0a9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:31.652834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f16964fc-48d8-46a2-92f0-75d1f638c0a9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:31.787552 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f16964fc-48d8-46a2-92f0-75d1f638c0a9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:31.794765 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f16964fc-48d8-46a2-92f0-75d1f638c0a9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.154564 Dec 15 13:37:31.795327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 81/166] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:31 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:32.552843 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-05e29111-9eb8-451e-884f-0fb72fccf4a7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:32.553854 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-05e29111-9eb8-451e-884f-0fb72fccf4a7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:32.563833 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05e29111-9eb8-451e-884f-0fb72fccf4a7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:32.564270 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05e29111-9eb8-451e-884f-0fb72fccf4a7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:32.565041 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05e29111-9eb8-451e-884f-0fb72fccf4a7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:32.565466 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05e29111-9eb8-451e-884f-0fb72fccf4a7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:32.811679 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e169f7fd-2ad6-4dd5-84bb-1fb4463801fb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:32.812280 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e169f7fd-2ad6-4dd5-84bb-1fb4463801fb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:32.818561 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e169f7fd-2ad6-4dd5-84bb-1fb4463801fb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:32.819004 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e169f7fd-2ad6-4dd5-84bb-1fb4463801fb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:32.819765 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e169f7fd-2ad6-4dd5-84bb-1fb4463801fb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:32.820190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e169f7fd-2ad6-4dd5-84bb-1fb4463801fb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:32.948889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e169f7fd-2ad6-4dd5-84bb-1fb4463801fb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:32.956249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e169f7fd-2ad6-4dd5-84bb-1fb4463801fb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.148282 Dec 15 13:37:32.956806 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 82/167] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:32 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:33.974445 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-28ca6f3f-4069-46e3-8bbe-9ca7fb6717a0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:33.975068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-28ca6f3f-4069-46e3-8bbe-9ca7fb6717a0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:33.982215 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-28ca6f3f-4069-46e3-8bbe-9ca7fb6717a0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:33.982657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-28ca6f3f-4069-46e3-8bbe-9ca7fb6717a0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:33.983425 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-28ca6f3f-4069-46e3-8bbe-9ca7fb6717a0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:33.983847 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-28ca6f3f-4069-46e3-8bbe-9ca7fb6717a0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:34.127508 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-28ca6f3f-4069-46e3-8bbe-9ca7fb6717a0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:34.135362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-28ca6f3f-4069-46e3-8bbe-9ca7fb6717a0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.164601 Dec 15 13:37:34.135901 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 83/168] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:33 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:35.096908 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-05e29111-9eb8-451e-884f-0fb72fccf4a7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 19342 microversion: 2.20 time: 2.547922 Dec 15 13:37:35.097556 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 86/169] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:32 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 19342 bytes in 2550 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:35.152858 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8176cca8-1c79-40e6-a1c5-f06074722fff tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:35.153452 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8176cca8-1c79-40e6-a1c5-f06074722fff tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:35.159810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8176cca8-1c79-40e6-a1c5-f06074722fff tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:35.160259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8176cca8-1c79-40e6-a1c5-f06074722fff tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:35.161028 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8176cca8-1c79-40e6-a1c5-f06074722fff tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:35.161455 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8176cca8-1c79-40e6-a1c5-f06074722fff tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:35.296506 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8176cca8-1c79-40e6-a1c5-f06074722fff tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:35.304121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8176cca8-1c79-40e6-a1c5-f06074722fff tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.155784 Dec 15 13:37:35.304691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 84/170] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:35 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:36.108670 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-dd4a0d49-2364-4596-b1a4-71a061623506 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:36.109644 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-dd4a0d49-2364-4596-b1a4-71a061623506 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:36.118011 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dd4a0d49-2364-4596-b1a4-71a061623506 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:36.118448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dd4a0d49-2364-4596-b1a4-71a061623506 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:36.119310 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dd4a0d49-2364-4596-b1a4-71a061623506 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:36.119629 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dd4a0d49-2364-4596-b1a4-71a061623506 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:36.321803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0bd96e22-14b0-42fb-b32c-befa9d8176f6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:36.322378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0bd96e22-14b0-42fb-b32c-befa9d8176f6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:36.329202 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0bd96e22-14b0-42fb-b32c-befa9d8176f6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:36.329641 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0bd96e22-14b0-42fb-b32c-befa9d8176f6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:36.330653 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0bd96e22-14b0-42fb-b32c-befa9d8176f6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:36.331249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0bd96e22-14b0-42fb-b32c-befa9d8176f6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:36.470705 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0bd96e22-14b0-42fb-b32c-befa9d8176f6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:36.478754 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0bd96e22-14b0-42fb-b32c-befa9d8176f6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.160675 Dec 15 13:37:36.479345 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 85/171] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:36 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:37.496088 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c7712f50-a258-4ea1-9d50-c17bf894d0cd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:37.496700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c7712f50-a258-4ea1-9d50-c17bf894d0cd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:37.502970 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c7712f50-a258-4ea1-9d50-c17bf894d0cd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:37.503440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c7712f50-a258-4ea1-9d50-c17bf894d0cd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:37.504180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c7712f50-a258-4ea1-9d50-c17bf894d0cd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:37.504607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c7712f50-a258-4ea1-9d50-c17bf894d0cd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:37.643590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c7712f50-a258-4ea1-9d50-c17bf894d0cd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:37.651885 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c7712f50-a258-4ea1-9d50-c17bf894d0cd tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.159661 Dec 15 13:37:37.652700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 86/172] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:37 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:38.671149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e036dab9-3889-4897-be08-be2a26391f84 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:38.671691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e036dab9-3889-4897-be08-be2a26391f84 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:38.678089 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e036dab9-3889-4897-be08-be2a26391f84 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:38.678574 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e036dab9-3889-4897-be08-be2a26391f84 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:38.679374 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e036dab9-3889-4897-be08-be2a26391f84 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:38.679803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e036dab9-3889-4897-be08-be2a26391f84 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:38.798202 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-dd4a0d49-2364-4596-b1a4-71a061623506 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 23794 microversion: 2.20 time: 2.692281 Dec 15 13:37:38.798635 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 87/173] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:36 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 23794 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:38.819226 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e036dab9-3889-4897-be08-be2a26391f84 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:38.827156 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e036dab9-3889-4897-be08-be2a26391f84 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.159708 Dec 15 13:37:38.827724 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 87/174] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:38 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:39.809329 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4a24b61c-043e-4828-81f1-3f622bb152ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:39.810345 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4a24b61c-043e-4828-81f1-3f622bb152ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:39.821413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4a24b61c-043e-4828-81f1-3f622bb152ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:39.821413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4a24b61c-043e-4828-81f1-3f622bb152ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:39.821413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4a24b61c-043e-4828-81f1-3f622bb152ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:39.821413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4a24b61c-043e-4828-81f1-3f622bb152ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:39.845576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5ef9b0bb-08e8-4ca9-afe8-14b646ca3455 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:39.846363 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5ef9b0bb-08e8-4ca9-afe8-14b646ca3455 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:39.855780 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5ef9b0bb-08e8-4ca9-afe8-14b646ca3455 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:39.856419 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5ef9b0bb-08e8-4ca9-afe8-14b646ca3455 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:39.857499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5ef9b0bb-08e8-4ca9-afe8-14b646ca3455 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:39.858150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5ef9b0bb-08e8-4ca9-afe8-14b646ca3455 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:39.914140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4a24b61c-043e-4828-81f1-3f622bb152ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 24325 microversion: 2.20 time: 0.109238 Dec 15 13:37:39.916448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 88/175] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:39 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 24325 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:40.035104 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5ef9b0bb-08e8-4ca9-afe8-14b646ca3455 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:40.042590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5ef9b0bb-08e8-4ca9-afe8-14b646ca3455 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.201759 Dec 15 13:37:40.053207 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 88/176] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:39 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:40.230475 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7b0b424e-1477-4627-a674-551a508d30c8 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:40.231297 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7b0b424e-1477-4627-a674-551a508d30c8 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:40.240746 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7b0b424e-1477-4627-a674-551a508d30c8 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:40.241358 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7b0b424e-1477-4627-a674-551a508d30c8 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:40.242413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7b0b424e-1477-4627-a674-551a508d30c8 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:40.242864 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7b0b424e-1477-4627-a674-551a508d30c8 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:40.271065 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7b0b424e-1477-4627-a674-551a508d30c8 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:37:40.392297 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7b0b424e-1477-4627-a674-551a508d30c8 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 204 len: 0 microversion: 2.1 time: 0.165725 Dec 15 13:37:40.393409 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 89/177] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:37:40 2021] DELETE /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:37:40.403626 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-596cbc1a-8c1d-44ae-aa9e-45f0006bc75b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:40.404490 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-596cbc1a-8c1d-44ae-aa9e-45f0006bc75b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:40.411158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-596cbc1a-8c1d-44ae-aa9e-45f0006bc75b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:40.411856 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-596cbc1a-8c1d-44ae-aa9e-45f0006bc75b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:40.412708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-596cbc1a-8c1d-44ae-aa9e-45f0006bc75b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:40.413197 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-596cbc1a-8c1d-44ae-aa9e-45f0006bc75b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:40.572525 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-596cbc1a-8c1d-44ae-aa9e-45f0006bc75b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:40.595369 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-596cbc1a-8c1d-44ae-aa9e-45f0006bc75b tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1555 microversion: 2.1 time: 0.196322 Dec 15 13:37:40.597077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 89/178] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:40 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:40.929132 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3dd637a6-918b-412c-8a42-60c8ba1ada9b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:40.931326 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3dd637a6-918b-412c-8a42-60c8ba1ada9b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:40.939060 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3dd637a6-918b-412c-8a42-60c8ba1ada9b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:40.939511 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3dd637a6-918b-412c-8a42-60c8ba1ada9b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:40.940299 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3dd637a6-918b-412c-8a42-60c8ba1ada9b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:40.940733 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3dd637a6-918b-412c-8a42-60c8ba1ada9b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:41.062166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9ca653a2-d5f4-4b09-b81d-0aea3ec4916d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:41.062794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9ca653a2-d5f4-4b09-b81d-0aea3ec4916d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:41.068877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9ca653a2-d5f4-4b09-b81d-0aea3ec4916d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:41.069323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9ca653a2-d5f4-4b09-b81d-0aea3ec4916d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:41.070158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9ca653a2-d5f4-4b09-b81d-0aea3ec4916d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:41.070771 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9ca653a2-d5f4-4b09-b81d-0aea3ec4916d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:41.307861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9ca653a2-d5f4-4b09-b81d-0aea3ec4916d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:41.318020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9ca653a2-d5f4-4b09-b81d-0aea3ec4916d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.260896 Dec 15 13:37:41.318947 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 90/179] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:41 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:41.666956 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0763d8ba-c8fa-40e7-be4a-ea8512f524c7 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:41.668392 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0763d8ba-c8fa-40e7-be4a-ea8512f524c7 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:41.674896 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0763d8ba-c8fa-40e7-be4a-ea8512f524c7 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:41.675447 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0763d8ba-c8fa-40e7-be4a-ea8512f524c7 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:41.676566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0763d8ba-c8fa-40e7-be4a-ea8512f524c7 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:41.677088 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0763d8ba-c8fa-40e7-be4a-ea8512f524c7 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:41.834289 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0763d8ba-c8fa-40e7-be4a-ea8512f524c7 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:41.843705 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0763d8ba-c8fa-40e7-be4a-ea8512f524c7 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1555 microversion: 2.1 time: 0.184201 Dec 15 13:37:41.854358 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 91/180] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:41 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:42.338450 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5744ad50-edbc-49a4-8516-5f5aa5aa3092 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:42.339063 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5744ad50-edbc-49a4-8516-5f5aa5aa3092 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:42.347189 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5744ad50-edbc-49a4-8516-5f5aa5aa3092 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:42.348118 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5744ad50-edbc-49a4-8516-5f5aa5aa3092 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:42.349194 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5744ad50-edbc-49a4-8516-5f5aa5aa3092 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:42.349608 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5744ad50-edbc-49a4-8516-5f5aa5aa3092 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:42.562684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5744ad50-edbc-49a4-8516-5f5aa5aa3092 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:42.591644 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5744ad50-edbc-49a4-8516-5f5aa5aa3092 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.246442 Dec 15 13:37:42.593973 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 92/181] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:42 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:42.864137 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f3bf5d8f-406d-4ea0-9d29-7fd5ca0f8f9d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:42.865302 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f3bf5d8f-406d-4ea0-9d29-7fd5ca0f8f9d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:42.875726 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3bf5d8f-406d-4ea0-9d29-7fd5ca0f8f9d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:42.876666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3bf5d8f-406d-4ea0-9d29-7fd5ca0f8f9d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:42.877665 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3bf5d8f-406d-4ea0-9d29-7fd5ca0f8f9d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:42.878264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3bf5d8f-406d-4ea0-9d29-7fd5ca0f8f9d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:43.184782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f3bf5d8f-406d-4ea0-9d29-7fd5ca0f8f9d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:43.194673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f3bf5d8f-406d-4ea0-9d29-7fd5ca0f8f9d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1555 microversion: 2.1 time: 0.336614 Dec 15 13:37:43.198614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 93/182] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:42 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1555 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:43.333061 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3dd637a6-918b-412c-8a42-60c8ba1ada9b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 26982 microversion: 2.20 time: 2.409495 Dec 15 13:37:43.337507 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 90/183] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:40 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 26982 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:43.613179 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-75fa7daf-fc55-4dd6-a93b-537f35411d70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:43.615001 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-75fa7daf-fc55-4dd6-a93b-537f35411d70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:43.623164 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-75fa7daf-fc55-4dd6-a93b-537f35411d70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:43.623580 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-75fa7daf-fc55-4dd6-a93b-537f35411d70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:43.624434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-75fa7daf-fc55-4dd6-a93b-537f35411d70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:43.624861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-75fa7daf-fc55-4dd6-a93b-537f35411d70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:43.804520 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-75fa7daf-fc55-4dd6-a93b-537f35411d70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:43.823291 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-75fa7daf-fc55-4dd6-a93b-537f35411d70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.216515 Dec 15 13:37:43.824479 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 94/184] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:43 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:44.216826 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-23dcc7e4-1d8a-43b7-a901-8f557279eaca tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:44.218438 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-23dcc7e4-1d8a-43b7-a901-8f557279eaca tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:44.229984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-23dcc7e4-1d8a-43b7-a901-8f557279eaca tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:44.230890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-23dcc7e4-1d8a-43b7-a901-8f557279eaca tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:44.232656 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-23dcc7e4-1d8a-43b7-a901-8f557279eaca tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:44.233684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-23dcc7e4-1d8a-43b7-a901-8f557279eaca tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:44.350906 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d5bfef14-3473-450c-bb8a-28da9beb1466 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:44.352667 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d5bfef14-3473-450c-bb8a-28da9beb1466 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:44.370372 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d5bfef14-3473-450c-bb8a-28da9beb1466 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:44.370878 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d5bfef14-3473-450c-bb8a-28da9beb1466 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:44.372001 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d5bfef14-3473-450c-bb8a-28da9beb1466 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:44.372490 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d5bfef14-3473-450c-bb8a-28da9beb1466 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:44.503122 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-23dcc7e4-1d8a-43b7-a901-8f557279eaca tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:44.516855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-23dcc7e4-1d8a-43b7-a901-8f557279eaca tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1555 microversion: 2.1 time: 0.307549 Dec 15 13:37:44.517798 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 91/185] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:44 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1555 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:44.521397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d5bfef14-3473-450c-bb8a-28da9beb1466 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 27307 microversion: 2.20 time: 0.176988 Dec 15 13:37:44.523043 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 95/186] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:44 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 27307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:44.851832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-022d0db4-01b5-45ac-816d-38592434ecaf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:44.852849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-022d0db4-01b5-45ac-816d-38592434ecaf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:44.863409 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-022d0db4-01b5-45ac-816d-38592434ecaf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:44.864328 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-022d0db4-01b5-45ac-816d-38592434ecaf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:44.865819 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-022d0db4-01b5-45ac-816d-38592434ecaf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:44.866685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-022d0db4-01b5-45ac-816d-38592434ecaf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.083487 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1636014245", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "c3738d27-4a35-4a97-97f2-d3c9cace88de"}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:45.132075 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-022d0db4-01b5-45ac-816d-38592434ecaf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:45.140391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-022d0db4-01b5-45ac-816d-38592434ecaf tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.293556 Dec 15 13:37:45.141252 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 92/187] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:44 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:45.213829 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] validate_networks() for [('c3738d27-4a35-4a97-97f2-d3c9cace88de', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:37:45.538248 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-67e227aa-4182-4c30-815c-4e8242932d4e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:45.541125 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-67e227aa-4182-4c30-815c-4e8242932d4e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:45.550899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-67e227aa-4182-4c30-815c-4e8242932d4e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.551575 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-67e227aa-4182-4c30-815c-4e8242932d4e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.552508 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-67e227aa-4182-4c30-815c-4e8242932d4e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.553245 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-67e227aa-4182-4c30-815c-4e8242932d4e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.653895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-67e227aa-4182-4c30-815c-4e8242932d4e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 27616 microversion: 2.20 time: 0.122234 Dec 15 13:37:45.655640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 93/188] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:45 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 27616 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:45.664172 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-104c0524-1877-46af-b110-730735ef6891 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:45.666573 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-104c0524-1877-46af-b110-730735ef6891 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:45.675274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-104c0524-1877-46af-b110-730735ef6891 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.675873 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-104c0524-1877-46af-b110-730735ef6891 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.677256 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-104c0524-1877-46af-b110-730735ef6891 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.678137 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-104c0524-1877-46af-b110-730735ef6891 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.822910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:37:45.823754 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:37:45.824380 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:37:45.825191 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:37:45.825790 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:37:45.835888 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.837075 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.838106 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:45.838692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:45.857177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Getting quotas for project b3823701b6f1423aa1ecd29bf162e5db. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:37:45.862141 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Getting quotas for user 66780c2cebcd40cfa78589c9b4cd4622 and project b3823701b6f1423aa1ecd29bf162e5db. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:37:45.879269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:37:45.883460 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:37:45.936711 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-104c0524-1877-46af-b110-730735ef6891 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:45.948709 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-104c0524-1877-46af-b110-730735ef6891 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1555 microversion: 2.1 time: 0.291391 Dec 15 13:37:45.950642 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 94/189] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:45 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:45.989162 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-65b9f51a-f4e5-4695-a585-5bf9137a0016 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909846 Dec 15 13:37:45.989860 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 96/190] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:37:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:37:46.001044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1977ba4f-62d0-41f7-a804-f1c6fd24d9f6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:46.002080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1977ba4f-62d0-41f7-a804-f1c6fd24d9f6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:46.160123 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-10820b76-03bc-4f1e-b0ad-41a85c8ea7b3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:46.161368 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-10820b76-03bc-4f1e-b0ad-41a85c8ea7b3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:46.174011 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10820b76-03bc-4f1e-b0ad-41a85c8ea7b3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:46.175334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10820b76-03bc-4f1e-b0ad-41a85c8ea7b3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:46.176625 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10820b76-03bc-4f1e-b0ad-41a85c8ea7b3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:46.179637 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10820b76-03bc-4f1e-b0ad-41a85c8ea7b3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:46.188870 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1977ba4f-62d0-41f7-a804-f1c6fd24d9f6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:46.199177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1977ba4f-62d0-41f7-a804-f1c6fd24d9f6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1214 microversion: 2.1 time: 0.202862 Dec 15 13:37:46.201158 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 95/191] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:45 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:46.503504 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-10820b76-03bc-4f1e-b0ad-41a85c8ea7b3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:46.561017 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-10820b76-03bc-4f1e-b0ad-41a85c8ea7b3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.406658 Dec 15 13:37:46.566634 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 97/192] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:46 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:37:46.669322 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a1e32d0a-a02e-49d1-9759-7986dbfd367e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:46.670529 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a1e32d0a-a02e-49d1-9759-7986dbfd367e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:46.691841 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a1e32d0a-a02e-49d1-9759-7986dbfd367e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:46.692685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a1e32d0a-a02e-49d1-9759-7986dbfd367e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:46.696440 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a1e32d0a-a02e-49d1-9759-7986dbfd367e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:46.697925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a1e32d0a-a02e-49d1-9759-7986dbfd367e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:46.834066 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a1e32d0a-a02e-49d1-9759-7986dbfd367e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 27958 microversion: 2.20 time: 0.170765 Dec 15 13:37:46.840100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 96/193] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:46 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 27958 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:46.969703 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0c8dd2d0-feb1-4a7f-8d6d-df8fc56b0d17 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:46.970940 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0c8dd2d0-feb1-4a7f-8d6d-df8fc56b0d17 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:46.982490 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-15cb5ec8-316c-4867-9a89-bffd28cf41b0 req-d25d061b-08eb-4b46-9b00-1be64c07308c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f740a90-17ff-49e3-8f5d-f1450ae6baf0", "name": "network-vif-deleted", "tag": "8265af4f-8d5b-423a-84c5-273348379f9f"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:46.984879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:46.984879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:37:46.994651 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c8dd2d0-feb1-4a7f-8d6d-df8fc56b0d17 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:46.995709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c8dd2d0-feb1-4a7f-8d6d-df8fc56b0d17 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:46.997958 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c8dd2d0-feb1-4a7f-8d6d-df8fc56b0d17 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.001769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-15cb5ec8-316c-4867-9a89-bffd28cf41b0 req-d25d061b-08eb-4b46-9b00-1be64c07308c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.002590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c8dd2d0-feb1-4a7f-8d6d-df8fc56b0d17 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.005855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-15cb5ec8-316c-4867-9a89-bffd28cf41b0 req-d25d061b-08eb-4b46-9b00-1be64c07308c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.035463 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-15cb5ec8-316c-4867-9a89-bffd28cf41b0 req-d25d061b-08eb-4b46-9b00-1be64c07308c service nova] Creating event network-vif-deleted:8265af4f-8d5b-423a-84c5-273348379f9f for instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 on hv-cinder-81322 Dec 15 13:37:47.040330 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-15cb5ec8-316c-4867-9a89-bffd28cf41b0 req-d25d061b-08eb-4b46-9b00-1be64c07308c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063364 Dec 15 13:37:47.041222 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 97/194] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:37:47.106684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0c8dd2d0-feb1-4a7f-8d6d-df8fc56b0d17 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:47.114702 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0c8dd2d0-feb1-4a7f-8d6d-df8fc56b0d17 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1513 microversion: 2.1 time: 0.149962 Dec 15 13:37:47.115471 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 98/195] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:46 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:47.219272 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5583e269-7de9-4402-b8ac-86e9e182b5ee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:47.220196 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5583e269-7de9-4402-b8ac-86e9e182b5ee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:47.227540 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5583e269-7de9-4402-b8ac-86e9e182b5ee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.228133 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5583e269-7de9-4402-b8ac-86e9e182b5ee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.229601 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5583e269-7de9-4402-b8ac-86e9e182b5ee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.230269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5583e269-7de9-4402-b8ac-86e9e182b5ee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.308699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5583e269-7de9-4402-b8ac-86e9e182b5ee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:47.318346 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5583e269-7de9-4402-b8ac-86e9e182b5ee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1266 microversion: 2.1 time: 0.103437 Dec 15 13:37:47.319009 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 98/196] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:47 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:47.581826 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8633ee72-d1e1-490a-820c-e01ef834c0c7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:47.582353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8633ee72-d1e1-490a-820c-e01ef834c0c7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:47.592722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8633ee72-d1e1-490a-820c-e01ef834c0c7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.593321 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8633ee72-d1e1-490a-820c-e01ef834c0c7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.596312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8633ee72-d1e1-490a-820c-e01ef834c0c7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.597004 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8633ee72-d1e1-490a-820c-e01ef834c0c7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.851281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-79011c3f-3c8a-4bc6-bbe6-4997886fb291 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:47.855178 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-79011c3f-3c8a-4bc6-bbe6-4997886fb291 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:47.857102 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8633ee72-d1e1-490a-820c-e01ef834c0c7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:47.866404 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8633ee72-d1e1-490a-820c-e01ef834c0c7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.291386 Dec 15 13:37:47.866983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 99/197] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:47 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:47.878107 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-79011c3f-3c8a-4bc6-bbe6-4997886fb291 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.879363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-79011c3f-3c8a-4bc6-bbe6-4997886fb291 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:47.880743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-79011c3f-3c8a-4bc6-bbe6-4997886fb291 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:47.881664 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-79011c3f-3c8a-4bc6-bbe6-4997886fb291 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.002071 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-79011c3f-3c8a-4bc6-bbe6-4997886fb291 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 28145 microversion: 2.20 time: 0.153738 Dec 15 13:37:48.003008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 99/198] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:47 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 28145 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:48.132278 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:48.133083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:48.145515 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.148983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.150431 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.151141 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.186852 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.187555 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.188248 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lazy-loading 'fault' on Instance uuid 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:37:48.247815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d42046f04e4d819193d705bf4557f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc3fb62e6fd4e12b55c29b671482f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:48.255083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-05b6c556-6535-4470-9546-18df39f88f6d tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 200 len: 1305 microversion: 2.1 time: 0.126498 Dec 15 13:37:48.255945 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 100/199] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:48 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:48.336869 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ea4bcfcc-6a02-49e3-a453-242891322af1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:48.337825 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ea4bcfcc-6a02-49e3-a453-242891322af1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:48.357171 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfcc-6a02-49e3-a453-242891322af1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.358392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfcc-6a02-49e3-a453-242891322af1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.360360 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfcc-6a02-49e3-a453-242891322af1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.361027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfcc-6a02-49e3-a453-242891322af1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.458996 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ea4bcfcc-6a02-49e3-a453-242891322af1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:48.467327 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ea4bcfcc-6a02-49e3-a453-242891322af1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1272 microversion: 2.1 time: 0.134447 Dec 15 13:37:48.468108 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 100/200] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:48 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:48.895641 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f4bc1d0d-041a-491d-bfa1-37a0216ec0be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:48.896339 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f4bc1d0d-041a-491d-bfa1-37a0216ec0be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:48.907740 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f4bc1d0d-041a-491d-bfa1-37a0216ec0be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.908377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f4bc1d0d-041a-491d-bfa1-37a0216ec0be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:48.909361 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f4bc1d0d-041a-491d-bfa1-37a0216ec0be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:48.909977 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f4bc1d0d-041a-491d-bfa1-37a0216ec0be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.014229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6a09b26f-d3bc-4bcc-a724-3f2331822a85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:49.016919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6a09b26f-d3bc-4bcc-a724-3f2331822a85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:49.031122 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a09b26f-d3bc-4bcc-a724-3f2331822a85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.033749 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a09b26f-d3bc-4bcc-a724-3f2331822a85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.034873 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a09b26f-d3bc-4bcc-a724-3f2331822a85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.035542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a09b26f-d3bc-4bcc-a724-3f2331822a85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.099975 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f4bc1d0d-041a-491d-bfa1-37a0216ec0be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:49.110693 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f4bc1d0d-041a-491d-bfa1-37a0216ec0be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.229855 Dec 15 13:37:49.112053 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 101/201] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:48 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:49.126432 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6a09b26f-d3bc-4bcc-a724-3f2331822a85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 28145 microversion: 2.20 time: 0.115973 Dec 15 13:37:49.127260 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 101/202] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:49 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 28145 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:49.275837 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:49.276831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:49.283748 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.284199 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.285419 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.286012 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.303029 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] HTTP exception thrown: Instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 could not be found. Dec 15 13:37:49.303895 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Returning 404 to user: Instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:37:49.304883 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-423dfc77-d31f-4b49-8688-af12ba8d1a3e tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 404 len: 111 microversion: 2.1 time: 0.035900 Dec 15 13:37:49.305673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 102/203] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:49 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:37:49.407615 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-2ca3e234-afcd-4aab-84fc-fde94784a17c req-6040c42a-4012-47b4-98dd-6c19e8a9cc37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb877af0-0c4c-4e87-afba-ac87eaca7e67", "tag": "d633ef25-5df0-4c20-bdf3-e7afadaef50f"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:49.409244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:49.409244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:37:49.445031 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-2ca3e234-afcd-4aab-84fc-fde94784a17c req-6040c42a-4012-47b4-98dd-6c19e8a9cc37 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.447895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-2ca3e234-afcd-4aab-84fc-fde94784a17c req-6040c42a-4012-47b4-98dd-6c19e8a9cc37 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.474039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-2ca3e234-afcd-4aab-84fc-fde94784a17c req-6040c42a-4012-47b4-98dd-6c19e8a9cc37 service nova] Creating event network-changed:d633ef25-5df0-4c20-bdf3-e7afadaef50f for instance bb877af0-0c4c-4e87-afba-ac87eaca7e67 on hv-cinder-81322 Dec 15 13:37:49.479567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-2ca3e234-afcd-4aab-84fc-fde94784a17c req-6040c42a-4012-47b4-98dd-6c19e8a9cc37 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078852 Dec 15 13:37:49.480973 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 102/204] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:49.486352 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1eb0a249-f97a-45a1-bee5-586343554f74 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:49.486962 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1eb0a249-f97a-45a1-bee5-586343554f74 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:49.487530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:49.488997 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:49.496631 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.501628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1eb0a249-f97a-45a1-bee5-586343554f74 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.502100 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1eb0a249-f97a-45a1-bee5-586343554f74 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.503057 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1eb0a249-f97a-45a1-bee5-586343554f74 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.503632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1eb0a249-f97a-45a1-bee5-586343554f74 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.507098 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.509299 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:49.510009 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:49.541592 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] HTTP exception thrown: Instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 could not be found. Dec 15 13:37:49.543911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Returning 404 to user: Instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:37:49.544888 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c301c0a4-d74f-43af-9e3d-aaafcc2ff879 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062623 Dec 15 13:37:49.546574 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 103/205] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:37:49 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:37:49.785690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1eb0a249-f97a-45a1-bee5-586343554f74 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:49.796114 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1eb0a249-f97a-45a1-bee5-586343554f74 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.315451 Dec 15 13:37:49.815017 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 103/206] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:49 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:50.128562 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-81a4d62d-2525-4420-bd06-01ce0cef3d75 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:50.129257 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-81a4d62d-2525-4420-bd06-01ce0cef3d75 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:50.138574 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81a4d62d-2525-4420-bd06-01ce0cef3d75 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.139026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81a4d62d-2525-4420-bd06-01ce0cef3d75 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.139818 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81a4d62d-2525-4420-bd06-01ce0cef3d75 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.140252 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81a4d62d-2525-4420-bd06-01ce0cef3d75 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.158489 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-511f6821-5bd3-48d0-814e-e03b1edb79d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:50.161617 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-511f6821-5bd3-48d0-814e-e03b1edb79d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:50.189207 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-511f6821-5bd3-48d0-814e-e03b1edb79d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.194457 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-511f6821-5bd3-48d0-814e-e03b1edb79d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.196799 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-511f6821-5bd3-48d0-814e-e03b1edb79d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.198566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-511f6821-5bd3-48d0-814e-e03b1edb79d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.338729 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-511f6821-5bd3-48d0-814e-e03b1edb79d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 28436 microversion: 2.20 time: 0.204682 Dec 15 13:37:50.339746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 104/207] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:50 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 28436 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:50.388849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-81a4d62d-2525-4420-bd06-01ce0cef3d75 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:50.398798 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-81a4d62d-2525-4420-bd06-01ce0cef3d75 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.273908 Dec 15 13:37:50.400543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 104/208] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:50 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:50.822785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:50.823887 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f99b069a-1703-497e-851a-d5eb76094119 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:50.824588 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f99b069a-1703-497e-851a-d5eb76094119 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:50.827014 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:50.837963 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f99b069a-1703-497e-851a-d5eb76094119 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.840634 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.841389 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f99b069a-1703-497e-851a-d5eb76094119 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.842062 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.843040 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f99b069a-1703-497e-851a-d5eb76094119 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.844031 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.844706 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f99b069a-1703-497e-851a-d5eb76094119 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.845288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.876738 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] HTTP exception thrown: Instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 could not be found. Dec 15 13:37:50.880818 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Returning 404 to user: Instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:37:50.885205 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a66b28ba-3b9b-48b4-b9d5-32b726832de5 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 404 len: 111 microversion: 2.1 time: 0.069447 Dec 15 13:37:50.889497 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 105/209] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:37:50 2021] DELETE /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:37:50.894602 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:50.895493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] [instance: 5f740a90-17ff-49e3-8f5d-f1450ae6baf0] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:50.902540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.903288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.904275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:50.904910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:50.920406 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] HTTP exception thrown: Instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 could not be found. Dec 15 13:37:50.921945 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] Returning 404 to user: Instance 5f740a90-17ff-49e3-8f5d-f1450ae6baf0 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:37:50.922494 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e09091dc-5cbf-44f6-aeab-dbd2e853f230 tempest-DeleteServersTestJSON-656923855 tempest-DeleteServersTestJSON-656923855-project] 10.222.0.83 "GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0" status: 404 len: 111 microversion: 2.1 time: 0.031317 Dec 15 13:37:50.926836 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 106/210] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:50 2021] GET /compute/v2.1/servers/5f740a90-17ff-49e3-8f5d-f1450ae6baf0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:37:51.067766 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f99b069a-1703-497e-851a-d5eb76094119 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:51.076786 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f99b069a-1703-497e-851a-d5eb76094119 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.260743 Dec 15 13:37:51.082035 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 105/211] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:50 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:51.358556 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d543cdfb-1a9e-4433-af4f-6dcbc6f7f869 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:51.359499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d543cdfb-1a9e-4433-af4f-6dcbc6f7f869 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:51.381234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d543cdfb-1a9e-4433-af4f-6dcbc6f7f869 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:51.381692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d543cdfb-1a9e-4433-af4f-6dcbc6f7f869 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:51.382521 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d543cdfb-1a9e-4433-af4f-6dcbc6f7f869 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:51.382962 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d543cdfb-1a9e-4433-af4f-6dcbc6f7f869 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:51.418685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6a451fc2-292f-4d72-90c6-34fe1c581271 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:51.421115 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6a451fc2-292f-4d72-90c6-34fe1c581271 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:51.433437 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a451fc2-292f-4d72-90c6-34fe1c581271 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:51.437789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a451fc2-292f-4d72-90c6-34fe1c581271 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:51.439058 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a451fc2-292f-4d72-90c6-34fe1c581271 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:51.439685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a451fc2-292f-4d72-90c6-34fe1c581271 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:51.474003 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d543cdfb-1a9e-4433-af4f-6dcbc6f7f869 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 28604 microversion: 2.20 time: 0.125294 Dec 15 13:37:51.479724 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 107/212] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:51 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 28604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:51.667116 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6a451fc2-292f-4d72-90c6-34fe1c581271 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:51.676625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6a451fc2-292f-4d72-90c6-34fe1c581271 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.263531 Dec 15 13:37:51.686971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 106/213] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:51 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:52.100600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-edbdd981-b0d8-4bd0-8bc1-5fc50777e56c tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:52.100600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-edbdd981-b0d8-4bd0-8bc1-5fc50777e56c tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:52.107543 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-edbdd981-b0d8-4bd0-8bc1-5fc50777e56c tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:52.108781 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-edbdd981-b0d8-4bd0-8bc1-5fc50777e56c tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:52.110239 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-edbdd981-b0d8-4bd0-8bc1-5fc50777e56c tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:52.110761 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-edbdd981-b0d8-4bd0-8bc1-5fc50777e56c tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:52.354890 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-edbdd981-b0d8-4bd0-8bc1-5fc50777e56c tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:52.366415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-edbdd981-b0d8-4bd0-8bc1-5fc50777e56c tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.276284 Dec 15 13:37:52.367748 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 108/214] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:52 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:52.485601 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-79231a7f-3152-4309-9476-9857f130c5be tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:52.487536 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-79231a7f-3152-4309-9476-9857f130c5be tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:52.495604 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-79231a7f-3152-4309-9476-9857f130c5be tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:52.496180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-79231a7f-3152-4309-9476-9857f130c5be tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:52.497361 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-79231a7f-3152-4309-9476-9857f130c5be tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:52.497852 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-79231a7f-3152-4309-9476-9857f130c5be tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:52.578320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-79231a7f-3152-4309-9476-9857f130c5be tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 28604 microversion: 2.20 time: 0.096216 Dec 15 13:37:52.579086 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 107/215] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:52 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 28604 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:52.697684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b908d06e-177b-4a09-936e-d501e3b5d459 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:52.697684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b908d06e-177b-4a09-936e-d501e3b5d459 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:52.704517 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b908d06e-177b-4a09-936e-d501e3b5d459 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:52.704972 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b908d06e-177b-4a09-936e-d501e3b5d459 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:52.705796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b908d06e-177b-4a09-936e-d501e3b5d459 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:52.706244 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b908d06e-177b-4a09-936e-d501e3b5d459 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:52.867617 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b908d06e-177b-4a09-936e-d501e3b5d459 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:52.875005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b908d06e-177b-4a09-936e-d501e3b5d459 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.182000 Dec 15 13:37:52.875573 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 109/216] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:52 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:53.385803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2d7d4a44-aebc-4483-a702-630b52adaf97 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:53.386003 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2d7d4a44-aebc-4483-a702-630b52adaf97 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:53.397317 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2d7d4a44-aebc-4483-a702-630b52adaf97 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:53.397801 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2d7d4a44-aebc-4483-a702-630b52adaf97 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:53.400080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2d7d4a44-aebc-4483-a702-630b52adaf97 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:53.400551 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2d7d4a44-aebc-4483-a702-630b52adaf97 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:53.590308 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-42ba6715-632d-477c-a614-54ed247eefc1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:53.592140 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-42ba6715-632d-477c-a614-54ed247eefc1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:53.599470 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2d7d4a44-aebc-4483-a702-630b52adaf97 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:53.605617 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42ba6715-632d-477c-a614-54ed247eefc1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:53.606191 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42ba6715-632d-477c-a614-54ed247eefc1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:53.606994 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42ba6715-632d-477c-a614-54ed247eefc1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:53.607711 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2d7d4a44-aebc-4483-a702-630b52adaf97 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.227069 Dec 15 13:37:53.608588 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42ba6715-632d-477c-a614-54ed247eefc1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:53.610114 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 108/217] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:53 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:53.757267 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-42ba6715-632d-477c-a614-54ed247eefc1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 28604 microversion: 2.20 time: 0.170215 Dec 15 13:37:53.760699 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 110/218] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:53 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 28604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:53.892286 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f575c43e-91d2-4f7c-a3ad-9273ad04d76d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:53.892899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f575c43e-91d2-4f7c-a3ad-9273ad04d76d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:53.902782 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f575c43e-91d2-4f7c-a3ad-9273ad04d76d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:53.903036 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f575c43e-91d2-4f7c-a3ad-9273ad04d76d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:53.904600 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f575c43e-91d2-4f7c-a3ad-9273ad04d76d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:53.905537 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f575c43e-91d2-4f7c-a3ad-9273ad04d76d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:54.141154 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f575c43e-91d2-4f7c-a3ad-9273ad04d76d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:54.152682 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f575c43e-91d2-4f7c-a3ad-9273ad04d76d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.262949 Dec 15 13:37:54.153796 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 109/219] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:53 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:54.631229 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-278c5524-4ef2-4dc0-b302-155bb5ffa38a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:54.631229 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-278c5524-4ef2-4dc0-b302-155bb5ffa38a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:54.644298 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-278c5524-4ef2-4dc0-b302-155bb5ffa38a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:54.644790 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-278c5524-4ef2-4dc0-b302-155bb5ffa38a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:54.655448 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-278c5524-4ef2-4dc0-b302-155bb5ffa38a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:54.655448 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-278c5524-4ef2-4dc0-b302-155bb5ffa38a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:54.768760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-11cb4293-086b-42db-8635-85a82635b568 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:54.769742 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-11cb4293-086b-42db-8635-85a82635b568 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:54.788064 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-11cb4293-086b-42db-8635-85a82635b568 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:54.788520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-11cb4293-086b-42db-8635-85a82635b568 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:54.789316 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-11cb4293-086b-42db-8635-85a82635b568 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:54.790331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-11cb4293-086b-42db-8635-85a82635b568 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:54.903771 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-11cb4293-086b-42db-8635-85a82635b568 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 28604 microversion: 2.20 time: 0.138891 Dec 15 13:37:54.905257 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 110/220] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:54 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 28604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:37:55.037240 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-278c5524-4ef2-4dc0-b302-155bb5ffa38a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:55.047798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-278c5524-4ef2-4dc0-b302-155bb5ffa38a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.422407 Dec 15 13:37:55.062878 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 111/221] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:54 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:55.172592 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-eac2a18d-7e3b-4248-bac0-bc7eb725e5e8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:55.173349 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-eac2a18d-7e3b-4248-bac0-bc7eb725e5e8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:55.187198 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eac2a18d-7e3b-4248-bac0-bc7eb725e5e8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:55.191646 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eac2a18d-7e3b-4248-bac0-bc7eb725e5e8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:55.192506 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eac2a18d-7e3b-4248-bac0-bc7eb725e5e8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:55.192949 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eac2a18d-7e3b-4248-bac0-bc7eb725e5e8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:55.706996 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-eac2a18d-7e3b-4248-bac0-bc7eb725e5e8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:55.715399 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-eac2a18d-7e3b-4248-bac0-bc7eb725e5e8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.548785 Dec 15 13:37:55.715984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 111/222] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:55 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:55.921785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b9e1c1a6-cc49-4ec1-b383-ba6563b18caa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:55.925017 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b9e1c1a6-cc49-4ec1-b383-ba6563b18caa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:55.934252 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b9e1c1a6-cc49-4ec1-b383-ba6563b18caa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:55.934967 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b9e1c1a6-cc49-4ec1-b383-ba6563b18caa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:55.936005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b9e1c1a6-cc49-4ec1-b383-ba6563b18caa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:55.938161 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b9e1c1a6-cc49-4ec1-b383-ba6563b18caa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:56.053580 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b9e1c1a6-cc49-4ec1-b383-ba6563b18caa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 29604 microversion: 2.20 time: 0.137833 Dec 15 13:37:56.057965 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 112/223] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:55 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 29604 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:56.067487 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7ee7a52a-a900-413e-b92b-8c5cbddf9d5a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:56.071026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7ee7a52a-a900-413e-b92b-8c5cbddf9d5a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:56.106334 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7ee7a52a-a900-413e-b92b-8c5cbddf9d5a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:56.108340 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7ee7a52a-a900-413e-b92b-8c5cbddf9d5a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:56.109490 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7ee7a52a-a900-413e-b92b-8c5cbddf9d5a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:56.110427 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7ee7a52a-a900-413e-b92b-8c5cbddf9d5a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:56.345894 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7ee7a52a-a900-413e-b92b-8c5cbddf9d5a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:56.355129 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7ee7a52a-a900-413e-b92b-8c5cbddf9d5a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.294314 Dec 15 13:37:56.356048 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 112/224] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:56 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:56.741880 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-35d71557-fe16-421b-b512-846c087a7a02 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:56.746011 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-35d71557-fe16-421b-b512-846c087a7a02 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:56.777963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-35d71557-fe16-421b-b512-846c087a7a02 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:56.781805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-35d71557-fe16-421b-b512-846c087a7a02 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:56.781805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-35d71557-fe16-421b-b512-846c087a7a02 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:56.781805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-35d71557-fe16-421b-b512-846c087a7a02 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:57.069241 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4c18244a-977d-4ce0-b8e9-840965b97605 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:57.072100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4c18244a-977d-4ce0-b8e9-840965b97605 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:57.087938 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4c18244a-977d-4ce0-b8e9-840965b97605 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:57.089923 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4c18244a-977d-4ce0-b8e9-840965b97605 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:57.091170 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4c18244a-977d-4ce0-b8e9-840965b97605 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:57.092313 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4c18244a-977d-4ce0-b8e9-840965b97605 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:57.280580 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-35d71557-fe16-421b-b512-846c087a7a02 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:57.294013 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-35d71557-fe16-421b-b512-846c087a7a02 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.560122 Dec 15 13:37:57.306239 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 113/225] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:56 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:57.372684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3ee45506-8e8c-4768-92cd-07e80940dc99 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:57.373299 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3ee45506-8e8c-4768-92cd-07e80940dc99 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:57.383647 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3ee45506-8e8c-4768-92cd-07e80940dc99 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:57.386126 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3ee45506-8e8c-4768-92cd-07e80940dc99 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:57.387217 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3ee45506-8e8c-4768-92cd-07e80940dc99 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:57.389982 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3ee45506-8e8c-4768-92cd-07e80940dc99 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:57.707697 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3ee45506-8e8c-4768-92cd-07e80940dc99 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:57.724155 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3ee45506-8e8c-4768-92cd-07e80940dc99 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.355057 Dec 15 13:37:57.725874 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 114/226] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:57 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:58.315518 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7197e05f-6410-451e-a2a4-db14c3580292 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:58.317023 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7197e05f-6410-451e-a2a4-db14c3580292 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:58.338057 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7197e05f-6410-451e-a2a4-db14c3580292 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:58.342395 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7197e05f-6410-451e-a2a4-db14c3580292 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:58.346963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7197e05f-6410-451e-a2a4-db14c3580292 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:58.348868 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7197e05f-6410-451e-a2a4-db14c3580292 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:58.714253 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7197e05f-6410-451e-a2a4-db14c3580292 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:58.725434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7197e05f-6410-451e-a2a4-db14c3580292 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1522 microversion: 2.1 time: 0.415710 Dec 15 13:37:58.726640 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 115/227] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:58 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:58.748668 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-f2232a44-cbf7-4b63-8022-f588a19347f6 req-570b42a8-19ab-4823-a5a9-2a9147b7dd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb877af0-0c4c-4e87-afba-ac87eaca7e67", "name": "network-vif-plugged", "status": "completed", "tag": "d633ef25-5df0-4c20-bdf3-e7afadaef50f"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:37:58.751888 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:37:58.751888 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:37:58.770730 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-f2232a44-cbf7-4b63-8022-f588a19347f6 req-570b42a8-19ab-4823-a5a9-2a9147b7dd41 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:58.772574 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-f2232a44-cbf7-4b63-8022-f588a19347f6 req-570b42a8-19ab-4823-a5a9-2a9147b7dd41 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:58.796288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-f2232a44-cbf7-4b63-8022-f588a19347f6 req-570b42a8-19ab-4823-a5a9-2a9147b7dd41 service nova] Creating event network-vif-plugged:d633ef25-5df0-4c20-bdf3-e7afadaef50f for instance bb877af0-0c4c-4e87-afba-ac87eaca7e67 on hv-cinder-81322 Dec 15 13:37:58.808429 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-f2232a44-cbf7-4b63-8022-f588a19347f6 req-570b42a8-19ab-4823-a5a9-2a9147b7dd41 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079237 Dec 15 13:37:58.813275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 116/228] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:37:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:37:58.822644 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-72a8c2fb-d9f7-4f6a-8e84-d8d74e576ff3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:58.823323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-72a8c2fb-d9f7-4f6a-8e84-d8d74e576ff3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:58.830865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-72a8c2fb-d9f7-4f6a-8e84-d8d74e576ff3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:58.831455 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-72a8c2fb-d9f7-4f6a-8e84-d8d74e576ff3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:58.832369 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-72a8c2fb-d9f7-4f6a-8e84-d8d74e576ff3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:58.832894 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-72a8c2fb-d9f7-4f6a-8e84-d8d74e576ff3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:59.043591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-72a8c2fb-d9f7-4f6a-8e84-d8d74e576ff3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:37:59.052615 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-72a8c2fb-d9f7-4f6a-8e84-d8d74e576ff3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.235286 Dec 15 13:37:59.053401 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 117/229] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:58 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:37:59.058756 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4c18244a-977d-4ce0-b8e9-840965b97605 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 33268 microversion: 2.20 time: 1.995371 Dec 15 13:37:59.060954 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 113/230] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:37:57 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 33268 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:37:59.754709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6ad6cb16-a325-40ed-94b1-a873dc3d991b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:37:59.755314 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6ad6cb16-a325-40ed-94b1-a873dc3d991b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:37:59.767672 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6ad6cb16-a325-40ed-94b1-a873dc3d991b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:59.771237 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6ad6cb16-a325-40ed-94b1-a873dc3d991b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:37:59.772187 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6ad6cb16-a325-40ed-94b1-a873dc3d991b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:37:59.776144 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6ad6cb16-a325-40ed-94b1-a873dc3d991b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.038938 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6ad6cb16-a325-40ed-94b1-a873dc3d991b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:00.047905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6ad6cb16-a325-40ed-94b1-a873dc3d991b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1502 microversion: 2.1 time: 0.298188 Dec 15 13:38:00.048569 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 118/231] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:37:59 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:00.068388 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e36e5244-bf68-4f35-b49e-cf46eec29d87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:00.069100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e36e5244-bf68-4f35-b49e-cf46eec29d87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:00.077452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e36e5244-bf68-4f35-b49e-cf46eec29d87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:00.078177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e36e5244-bf68-4f35-b49e-cf46eec29d87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.079174 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e36e5244-bf68-4f35-b49e-cf46eec29d87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:00.079773 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e36e5244-bf68-4f35-b49e-cf46eec29d87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.080758 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e20c46ee-122d-4671-a00f-cc1fe7a52cee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:00.082249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e20c46ee-122d-4671-a00f-cc1fe7a52cee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:00.094070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e20c46ee-122d-4671-a00f-cc1fe7a52cee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:00.095468 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e20c46ee-122d-4671-a00f-cc1fe7a52cee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.096783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e20c46ee-122d-4671-a00f-cc1fe7a52cee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:00.097393 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e20c46ee-122d-4671-a00f-cc1fe7a52cee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.308428 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e36e5244-bf68-4f35-b49e-cf46eec29d87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:00.327283 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e36e5244-bf68-4f35-b49e-cf46eec29d87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1515 microversion: 2.1 time: 0.263407 Dec 15 13:38:00.328714 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 114/232] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:00 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:00.351011 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c7b5e577-9a4e-4f47-9154-c051c6caf0ca tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:00.361439 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c7b5e577-9a4e-4f47-9154-c051c6caf0ca tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:00.393136 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c7b5e577-9a4e-4f47-9154-c051c6caf0ca tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:00.393599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c7b5e577-9a4e-4f47-9154-c051c6caf0ca tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.399451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c7b5e577-9a4e-4f47-9154-c051c6caf0ca tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:00.400409 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c7b5e577-9a4e-4f47-9154-c051c6caf0ca tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:00.528755 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c7b5e577-9a4e-4f47-9154-c051c6caf0ca tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 34129 microversion: 2.20 time: 0.184889 Dec 15 13:38:00.529645 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 115/233] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:00 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 34129 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:00.694891 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e20c46ee-122d-4671-a00f-cc1fe7a52cee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:00.707440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e20c46ee-122d-4671-a00f-cc1fe7a52cee tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1314 microversion: 2.1 time: 0.640214 Dec 15 13:38:00.718259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 119/234] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:00 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:01.391360 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-02dc01bf-3b45-47b0-a28e-0ae7b1c27710 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:01.392361 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-02dc01bf-3b45-47b0-a28e-0ae7b1c27710 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:01.401898 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-02dc01bf-3b45-47b0-a28e-0ae7b1c27710 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.402361 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-02dc01bf-3b45-47b0-a28e-0ae7b1c27710 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.404869 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-02dc01bf-3b45-47b0-a28e-0ae7b1c27710 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.405533 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-02dc01bf-3b45-47b0-a28e-0ae7b1c27710 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.440140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-02dc01bf-3b45-47b0-a28e-0ae7b1c27710 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'flavor' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:38:01.543968 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-980aa501-668b-4303-8f0c-d14486dd7021 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:01.545284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-980aa501-668b-4303-8f0c-d14486dd7021 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:01.574338 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-980aa501-668b-4303-8f0c-d14486dd7021 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.574968 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-980aa501-668b-4303-8f0c-d14486dd7021 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.576076 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-980aa501-668b-4303-8f0c-d14486dd7021 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.576855 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-980aa501-668b-4303-8f0c-d14486dd7021 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.595754 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-02dc01bf-3b45-47b0-a28e-0ae7b1c27710 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/action" status: 200 len: 32 microversion: 2.1 time: 0.208504 Dec 15 13:38:01.596696 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 116/235] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:38:01 2021] POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:38:01.606701 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-973b6cf0-f142-4ff5-b302-1b9023e82a2a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:01.619689 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-973b6cf0-f142-4ff5-b302-1b9023e82a2a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:01.634884 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-973b6cf0-f142-4ff5-b302-1b9023e82a2a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.635824 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-973b6cf0-f142-4ff5-b302-1b9023e82a2a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.636705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-973b6cf0-f142-4ff5-b302-1b9023e82a2a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.637380 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-973b6cf0-f142-4ff5-b302-1b9023e82a2a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.928613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-973b6cf0-f142-4ff5-b302-1b9023e82a2a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:01.936856 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-973b6cf0-f142-4ff5-b302-1b9023e82a2a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.334639 Dec 15 13:38:01.947526 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 117/236] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:01 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:01.952462 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a6e193df-7783-46b6-a699-9d989b38d769 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:01.953110 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a6e193df-7783-46b6-a699-9d989b38d769 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:01.972173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a6e193df-7783-46b6-a699-9d989b38d769 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.972612 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a6e193df-7783-46b6-a699-9d989b38d769 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:01.974463 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a6e193df-7783-46b6-a699-9d989b38d769 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:01.974894 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a6e193df-7783-46b6-a699-9d989b38d769 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:02.293510 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a6e193df-7783-46b6-a699-9d989b38d769 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:02.303390 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a6e193df-7783-46b6-a699-9d989b38d769 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1498 microversion: 2.1 time: 0.354749 Dec 15 13:38:02.304044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 118/237] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:01 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1498 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:02.953534 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-dab59219-37ac-44d2-9744-bf964c798269 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:02.954896 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-dab59219-37ac-44d2-9744-bf964c798269 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:02.961257 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dab59219-37ac-44d2-9744-bf964c798269 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:02.961797 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dab59219-37ac-44d2-9744-bf964c798269 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:02.962810 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dab59219-37ac-44d2-9744-bf964c798269 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:02.963366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dab59219-37ac-44d2-9744-bf964c798269 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:03.118684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-dab59219-37ac-44d2-9744-bf964c798269 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:03.131526 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-dab59219-37ac-44d2-9744-bf964c798269 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.181768 Dec 15 13:38:03.132125 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 119/238] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:02 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:04.149964 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1eec4e7d-cdb2-43c3-b6d7-642997373ad3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:04.150663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1eec4e7d-cdb2-43c3-b6d7-642997373ad3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:04.165322 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1eec4e7d-cdb2-43c3-b6d7-642997373ad3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:04.166392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1eec4e7d-cdb2-43c3-b6d7-642997373ad3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:04.168076 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1eec4e7d-cdb2-43c3-b6d7-642997373ad3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:04.168756 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1eec4e7d-cdb2-43c3-b6d7-642997373ad3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:04.202672 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-980aa501-668b-4303-8f0c-d14486dd7021 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 38083 microversion: 2.20 time: 2.664129 Dec 15 13:38:04.208611 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 120/239] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:01 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 38083 bytes in 2671 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:04.387026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1eec4e7d-cdb2-43c3-b6d7-642997373ad3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:04.397942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1eec4e7d-cdb2-43c3-b6d7-642997373ad3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.252045 Dec 15 13:38:04.398956 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 120/240] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:04 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:05.217413 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1cc76dcd-43fe-46b5-bea0-919df5aeadc4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:05.219165 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1cc76dcd-43fe-46b5-bea0-919df5aeadc4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:05.226906 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1cc76dcd-43fe-46b5-bea0-919df5aeadc4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:05.227493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1cc76dcd-43fe-46b5-bea0-919df5aeadc4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:05.228466 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1cc76dcd-43fe-46b5-bea0-919df5aeadc4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:05.239103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1cc76dcd-43fe-46b5-bea0-919df5aeadc4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:05.415152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-aa2a6fed-aba0-48ac-9962-6dd09a6d7b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:05.415796 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-aa2a6fed-aba0-48ac-9962-6dd09a6d7b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:05.428083 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-aa2a6fed-aba0-48ac-9962-6dd09a6d7b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:05.437727 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-aa2a6fed-aba0-48ac-9962-6dd09a6d7b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:05.439917 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-aa2a6fed-aba0-48ac-9962-6dd09a6d7b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:05.440385 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-aa2a6fed-aba0-48ac-9962-6dd09a6d7b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:05.775008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-aa2a6fed-aba0-48ac-9962-6dd09a6d7b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:05.794639 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-aa2a6fed-aba0-48ac-9962-6dd09a6d7b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.379460 Dec 15 13:38:05.805326 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 121/241] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:05 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:06.929988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b3e141e8-3357-45e6-84f5-7e650423c248 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Action: 'create', calling method: .version_select at 0x7fd79c2ee310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2022049678"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:06.944017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-b3e141e8-3357-45e6-84f5-7e650423c248 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for project c0da9050a08e442887ca8dc346374836. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:06.948386 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-b3e141e8-3357-45e6-84f5-7e650423c248 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for user 7e3a3afdfc4c44a29d0f3df50a5ed2ac and project c0da9050a08e442887ca8dc346374836. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:07.211416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-b3e141e8-3357-45e6-84f5-7e650423c248 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for project c0da9050a08e442887ca8dc346374836. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:07.215041 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-b3e141e8-3357-45e6-84f5-7e650423c248 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for user 7e3a3afdfc4c44a29d0f3df50a5ed2ac and project c0da9050a08e442887ca8dc346374836. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:07.228122 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b3e141e8-3357-45e6-84f5-7e650423c248 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.482119 Dec 15 13:38:07.228729 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 122/242] 10.222.0.83 () {60 vars in 1157 bytes} [Wed Dec 15 13:38:06 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:07.232945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3ca33ffe-0af2-4d32-b11a-838646fde4c8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:07.233542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3ca33ffe-0af2-4d32-b11a-838646fde4c8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:07.239531 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3ca33ffe-0af2-4d32-b11a-838646fde4c8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:07.240102 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3ca33ffe-0af2-4d32-b11a-838646fde4c8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:07.240728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3ca33ffe-0af2-4d32-b11a-838646fde4c8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:07.241155 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3ca33ffe-0af2-4d32-b11a-838646fde4c8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:07.347843 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1cc76dcd-43fe-46b5-bea0-919df5aeadc4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 38153 microversion: 2.20 time: 2.135140 Dec 15 13:38:07.349810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 121/243] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:05 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 38153 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:07.606554 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3ca33ffe-0af2-4d32-b11a-838646fde4c8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:07.615015 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3ca33ffe-0af2-4d32-b11a-838646fde4c8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.385076 Dec 15 13:38:07.616162 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 123/244] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:07 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:07.942705 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-618adc9a-d404-49b1-af15-75004b57efb3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:07.943787 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-618adc9a-d404-49b1-af15-75004b57efb3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:07.953170 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-618adc9a-d404-49b1-af15-75004b57efb3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:07.953905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-618adc9a-d404-49b1-af15-75004b57efb3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:07.956064 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-618adc9a-d404-49b1-af15-75004b57efb3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:07.959479 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-618adc9a-d404-49b1-af15-75004b57efb3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:07.998841 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-618adc9a-d404-49b1-af15-75004b57efb3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:38:08.135284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-618adc9a-d404-49b1-af15-75004b57efb3 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 204 len: 0 microversion: 2.1 time: 0.196575 Dec 15 13:38:08.137738 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 122/245] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:38:07 2021] DELETE /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:38:08.146031 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a041bb1d-0bc2-4980-83c1-76de85b1b950 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:08.147275 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a041bb1d-0bc2-4980-83c1-76de85b1b950 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:08.154130 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a041bb1d-0bc2-4980-83c1-76de85b1b950 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:08.154916 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a041bb1d-0bc2-4980-83c1-76de85b1b950 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:08.155797 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a041bb1d-0bc2-4980-83c1-76de85b1b950 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:08.156447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a041bb1d-0bc2-4980-83c1-76de85b1b950 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:08.361038 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6930ebcc-6cdf-4480-bb1a-29a64f89c55f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:08.362736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6930ebcc-6cdf-4480-bb1a-29a64f89c55f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:08.371181 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6930ebcc-6cdf-4480-bb1a-29a64f89c55f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:08.372053 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6930ebcc-6cdf-4480-bb1a-29a64f89c55f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:08.372657 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a041bb1d-0bc2-4980-83c1-76de85b1b950 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:08.373363 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6930ebcc-6cdf-4480-bb1a-29a64f89c55f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:08.374015 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6930ebcc-6cdf-4480-bb1a-29a64f89c55f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:08.380088 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a041bb1d-0bc2-4980-83c1-76de85b1b950 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1504 microversion: 2.1 time: 0.237891 Dec 15 13:38:08.390675 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 124/246] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:08 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:08.471633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6930ebcc-6cdf-4480-bb1a-29a64f89c55f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 38160 microversion: 2.20 time: 0.114350 Dec 15 13:38:08.472657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 123/247] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:08 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 38160 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:38:08.631847 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fe23a3d7-42e8-4af5-bebc-953c7ee66ce0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:08.632572 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fe23a3d7-42e8-4af5-bebc-953c7ee66ce0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:08.639833 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fe23a3d7-42e8-4af5-bebc-953c7ee66ce0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:08.640277 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fe23a3d7-42e8-4af5-bebc-953c7ee66ce0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:08.641281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fe23a3d7-42e8-4af5-bebc-953c7ee66ce0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:08.641718 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fe23a3d7-42e8-4af5-bebc-953c7ee66ce0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:08.888637 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fe23a3d7-42e8-4af5-bebc-953c7ee66ce0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:08.897782 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fe23a3d7-42e8-4af5-bebc-953c7ee66ce0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.269551 Dec 15 13:38:08.898441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 125/248] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:08 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:09.405999 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e3d707fa-e43d-4094-bbce-9fbfce3e9b2b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:09.408045 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e3d707fa-e43d-4094-bbce-9fbfce3e9b2b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:09.425118 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d707fa-e43d-4094-bbce-9fbfce3e9b2b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.425612 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d707fa-e43d-4094-bbce-9fbfce3e9b2b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.426487 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d707fa-e43d-4094-bbce-9fbfce3e9b2b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.427073 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d707fa-e43d-4094-bbce-9fbfce3e9b2b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.486280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-37e4de5f-c9a5-4b35-aecb-b3a1db897778 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:09.487248 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-37e4de5f-c9a5-4b35-aecb-b3a1db897778 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:09.497412 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-37e4de5f-c9a5-4b35-aecb-b3a1db897778 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.497983 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-37e4de5f-c9a5-4b35-aecb-b3a1db897778 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.498705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-37e4de5f-c9a5-4b35-aecb-b3a1db897778 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.499133 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-37e4de5f-c9a5-4b35-aecb-b3a1db897778 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.622142 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-37e4de5f-c9a5-4b35-aecb-b3a1db897778 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 200 len: 38294 microversion: 2.20 time: 0.141413 Dec 15 13:38:09.628320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 126/249] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:09 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 38294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:09.638566 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3d9c121c-a5bd-4d27-97a0-4b0f837407b8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:09.639396 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3d9c121c-a5bd-4d27-97a0-4b0f837407b8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:09.647055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d9c121c-a5bd-4d27-97a0-4b0f837407b8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.648987 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d9c121c-a5bd-4d27-97a0-4b0f837407b8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.650172 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d9c121c-a5bd-4d27-97a0-4b0f837407b8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.657118 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d9c121c-a5bd-4d27-97a0-4b0f837407b8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.686246 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3d9c121c-a5bd-4d27-97a0-4b0f837407b8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/ips" status: 200 len: 151 microversion: 2.20 time: 0.052731 Dec 15 13:38:09.687012 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 127/250] 10.222.0.83 () {60 vars in 1288 bytes} [Wed Dec 15 13:38:09 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:38:09.701516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e3d707fa-e43d-4094-bbce-9fbfce3e9b2b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:09.710752 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e3d707fa-e43d-4094-bbce-9fbfce3e9b2b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1504 microversion: 2.1 time: 0.316307 Dec 15 13:38:09.711916 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 124/251] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:09 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:09.932831 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1bf5cb4c-bda6-4fd0-a894-4b168a79b669 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:09.936911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1bf5cb4c-bda6-4fd0-a894-4b168a79b669 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:09.965288 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb4c-bda6-4fd0-a894-4b168a79b669 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.971459 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb4c-bda6-4fd0-a894-4b168a79b669 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:09.974601 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb4c-bda6-4fd0-a894-4b168a79b669 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:09.975857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb4c-bda6-4fd0-a894-4b168a79b669 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:10.370470 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1bf5cb4c-bda6-4fd0-a894-4b168a79b669 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:10.379513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1bf5cb4c-bda6-4fd0-a894-4b168a79b669 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.456672 Dec 15 13:38:10.380698 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 128/252] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:09 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:10.717540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-5a9ed6e4-2467-4dbd-a35c-86d5768e571a req-c6e60dfb-b6e2-4b4a-888d-3e25d977754e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb877af0-0c4c-4e87-afba-ac87eaca7e67", "name": "network-vif-deleted", "tag": "d633ef25-5df0-4c20-bdf3-e7afadaef50f"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:10.719099 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:10.719099 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:38:10.728602 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-03ea3cf7-632f-4cb3-a547-694f4d02e4b9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:10.729079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-03ea3cf7-632f-4cb3-a547-694f4d02e4b9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:10.732075 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-5a9ed6e4-2467-4dbd-a35c-86d5768e571a req-c6e60dfb-b6e2-4b4a-888d-3e25d977754e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:10.732614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-5a9ed6e4-2467-4dbd-a35c-86d5768e571a req-c6e60dfb-b6e2-4b4a-888d-3e25d977754e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:10.740436 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03ea3cf7-632f-4cb3-a547-694f4d02e4b9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:10.740798 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03ea3cf7-632f-4cb3-a547-694f4d02e4b9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:10.741627 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03ea3cf7-632f-4cb3-a547-694f4d02e4b9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:10.743585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03ea3cf7-632f-4cb3-a547-694f4d02e4b9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:10.748799 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-5a9ed6e4-2467-4dbd-a35c-86d5768e571a req-c6e60dfb-b6e2-4b4a-888d-3e25d977754e service nova] Creating event network-vif-deleted:d633ef25-5df0-4c20-bdf3-e7afadaef50f for instance bb877af0-0c4c-4e87-afba-ac87eaca7e67 on hv-cinder-81322 Dec 15 13:38:10.762503 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-5a9ed6e4-2467-4dbd-a35c-86d5768e571a req-c6e60dfb-b6e2-4b4a-888d-3e25d977754e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047463 Dec 15 13:38:10.774439 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 125/253] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:10.844063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-03ea3cf7-632f-4cb3-a547-694f4d02e4b9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:10.854539 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-03ea3cf7-632f-4cb3-a547-694f4d02e4b9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 200 len: 1462 microversion: 2.1 time: 0.130358 Dec 15 13:38:10.856657 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 129/254] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:10 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 1462 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:11.398018 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3127988b-dd79-4bf7-b9c0-5df2c04340dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:11.398825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3127988b-dd79-4bf7-b9c0-5df2c04340dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:11.405964 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3127988b-dd79-4bf7-b9c0-5df2c04340dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:11.406409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3127988b-dd79-4bf7-b9c0-5df2c04340dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:11.407194 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3127988b-dd79-4bf7-b9c0-5df2c04340dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:11.407676 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3127988b-dd79-4bf7-b9c0-5df2c04340dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:11.567984 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3127988b-dd79-4bf7-b9c0-5df2c04340dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:11.576386 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3127988b-dd79-4bf7-b9c0-5df2c04340dc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.182916 Dec 15 13:38:11.577435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 126/255] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:11 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:11.872305 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:11.873173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: bb877af0-0c4c-4e87-afba-ac87eaca7e67] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:11.880648 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:11.881363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:11.882331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:11.882895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:12.100468 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] HTTP exception thrown: Instance bb877af0-0c4c-4e87-afba-ac87eaca7e67 could not be found. Dec 15 13:38:12.101578 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Returning 404 to user: Instance bb877af0-0c4c-4e87-afba-ac87eaca7e67 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:38:12.104164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-110563d5-c530-4be3-9158-91eda9bbf549 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67" status: 404 len: 111 microversion: 2.1 time: 0.235183 Dec 15 13:38:12.105159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 130/256] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:11 2021] GET /compute/v2.1/servers/bb877af0-0c4c-4e87-afba-ac87eaca7e67 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:38:12.110496 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-39979060-cbff-4fb6-9bfa-020c911763cf tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:12.112509 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-39979060-cbff-4fb6-9bfa-020c911763cf tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:12.135695 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-39979060-cbff-4fb6-9bfa-020c911763cf tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:12.137447 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-39979060-cbff-4fb6-9bfa-020c911763cf tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:12.139456 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-39979060-cbff-4fb6-9bfa-020c911763cf tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:12.139921 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-39979060-cbff-4fb6-9bfa-020c911763cf tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:12.179591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-39979060-cbff-4fb6-9bfa-020c911763cf tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lazy-loading 'flavor' on Instance uuid 16af4c97-7ce7-47dd-8493-24d19a46221d {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:38:12.305715 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1786577500", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "c3738d27-4a35-4a97-97f2-d3c9cace88de"}]}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:12.481783 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.network.neutron [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] validate_networks() for [('c3738d27-4a35-4a97-97f2-d3c9cace88de', None, None, None, None, None)] {{(pid=122611) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:38:12.768790 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-39979060-cbff-4fb6-9bfa-020c911763cf tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 202 len: 0 microversion: 2.20 time: 0.668596 Dec 15 13:38:12.769906 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 127/257] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:12 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:38:12.777432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7fdcddb2-c595-4278-95d6-10873f6cb475 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:12.778721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7fdcddb2-c595-4278-95d6-10873f6cb475 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:12.790030 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7fdcddb2-c595-4278-95d6-10873f6cb475 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:12.791388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7fdcddb2-c595-4278-95d6-10873f6cb475 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:12.792662 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7fdcddb2-c595-4278-95d6-10873f6cb475 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:12.804848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7fdcddb2-c595-4278-95d6-10873f6cb475 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:13.082170 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Flavor limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:38:13.083182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Image limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:38:13.083653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Flavor pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:38:13.084089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Image pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:38:13.084452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:38:13.098025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:13.099840 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:13.106023 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:13.106624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:13.107344 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7fdcddb2-c595-4278-95d6-10873f6cb475 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:13.116252 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7fdcddb2-c595-4278-95d6-10873f6cb475 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.344974 Dec 15 13:38:13.116900 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 128/258] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:12 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:13.136245 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Getting quotas for project b3823701b6f1423aa1ecd29bf162e5db. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:13.141665 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:13.142377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:13.143678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Getting quotas for user 66780c2cebcd40cfa78589c9b4cd4622 and project b3823701b6f1423aa1ecd29bf162e5db. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:13.162439 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:13.162887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:13.164284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:13.164931 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:13.168271 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Going to run 1 instances... {{(pid=122611) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:38:13.175755 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:38:13.243210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e60765c6-6c11-494e-8a08-437a486ca93e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941425 Dec 15 13:38:13.244171 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 131/259] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:38:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 13:38:13.270095 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-55223401-0bde-418f-b894-191abb7ce239 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:13.270801 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-55223401-0bde-418f-b894-191abb7ce239 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:13.348798 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-55223401-0bde-418f-b894-191abb7ce239 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:13.361001 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-55223401-0bde-418f-b894-191abb7ce239 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1214 microversion: 2.1 time: 0.110290 Dec 15 13:38:13.361632 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 132/260] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:13 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:13.517176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:13.526269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:13.533532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:13.534745 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-594281d4-33b8-4627-a0a2-3f28236dbcb8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.417004 Dec 15 13:38:13.550452 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 129/261] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:13 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:14.133227 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-152de2fe-66de-40ee-a654-6a4789403abc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:14.133895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-152de2fe-66de-40ee-a654-6a4789403abc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:14.140890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-152de2fe-66de-40ee-a654-6a4789403abc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:14.141419 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-152de2fe-66de-40ee-a654-6a4789403abc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:14.142297 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-152de2fe-66de-40ee-a654-6a4789403abc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:14.142937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-152de2fe-66de-40ee-a654-6a4789403abc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:14.294189 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-152de2fe-66de-40ee-a654-6a4789403abc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:14.302871 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-152de2fe-66de-40ee-a654-6a4789403abc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.173173 Dec 15 13:38:14.304071 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 133/262] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:14 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:14.378971 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b27fe6d1-8812-401d-af0e-475f61eff40d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:14.379841 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b27fe6d1-8812-401d-af0e-475f61eff40d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:14.395994 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b27fe6d1-8812-401d-af0e-475f61eff40d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:14.396444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b27fe6d1-8812-401d-af0e-475f61eff40d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:14.404997 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b27fe6d1-8812-401d-af0e-475f61eff40d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:14.405606 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b27fe6d1-8812-401d-af0e-475f61eff40d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:14.530335 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b27fe6d1-8812-401d-af0e-475f61eff40d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:14.542436 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b27fe6d1-8812-401d-af0e-475f61eff40d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1266 microversion: 2.1 time: 0.167485 Dec 15 13:38:14.543195 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 130/263] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:14 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:14.553088 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:14.554285 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:14.562937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:14.562937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:14.563472 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:14.563818 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:14.876738 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:14.895891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:14.903677 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:14.906106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9194fc97-b974-4672-85c8-d7fdec5e81a0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.356346 Dec 15 13:38:14.906846 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 134/264] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:14 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:15.320479 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-662298c8-0552-40fb-bdac-d460e42a7010 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:15.321624 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-662298c8-0552-40fb-bdac-d460e42a7010 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:15.339609 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-662298c8-0552-40fb-bdac-d460e42a7010 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:15.340428 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-662298c8-0552-40fb-bdac-d460e42a7010 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:15.341451 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-662298c8-0552-40fb-bdac-d460e42a7010 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:15.342113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-662298c8-0552-40fb-bdac-d460e42a7010 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:15.548235 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-662298c8-0552-40fb-bdac-d460e42a7010 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:15.558117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-662298c8-0552-40fb-bdac-d460e42a7010 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.241361 Dec 15 13:38:15.562599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0edd236b-a2f0-47c2-8b81-30c572c29508 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:15.563224 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0edd236b-a2f0-47c2-8b81-30c572c29508 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:15.567551 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 131/265] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:15 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:15.571899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0edd236b-a2f0-47c2-8b81-30c572c29508 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:15.572358 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0edd236b-a2f0-47c2-8b81-30c572c29508 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:15.573152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0edd236b-a2f0-47c2-8b81-30c572c29508 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:15.574236 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0edd236b-a2f0-47c2-8b81-30c572c29508 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:15.781964 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0edd236b-a2f0-47c2-8b81-30c572c29508 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:15.794385 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0edd236b-a2f0-47c2-8b81-30c572c29508 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.235818 Dec 15 13:38:15.803450 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 135/266] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:15 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:15.924313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:15.924909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:15.942782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:15.943235 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:15.944054 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:15.944480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.134784 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:16.144276 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:16.146415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:16.147770 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-77da174f-9774-4ae8-97a0-342c00181b89 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.227225 Dec 15 13:38:16.148954 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 132/267] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:15 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:16.579440 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f01ae316-ac5c-4d95-9cf2-35d72959468f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:16.580138 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f01ae316-ac5c-4d95-9cf2-35d72959468f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:16.595427 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f01ae316-ac5c-4d95-9cf2-35d72959468f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.596929 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f01ae316-ac5c-4d95-9cf2-35d72959468f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.597976 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f01ae316-ac5c-4d95-9cf2-35d72959468f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.598576 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f01ae316-ac5c-4d95-9cf2-35d72959468f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.812337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f01ae316-ac5c-4d95-9cf2-35d72959468f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:16.814441 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3578960a-218e-419f-93f5-85a93251f26b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:16.815397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3578960a-218e-419f-93f5-85a93251f26b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:16.820875 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f01ae316-ac5c-4d95-9cf2-35d72959468f tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.247470 Dec 15 13:38:16.822311 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 136/268] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:16 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:16.833121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3578960a-218e-419f-93f5-85a93251f26b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.834065 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3578960a-218e-419f-93f5-85a93251f26b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.835684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3578960a-218e-419f-93f5-85a93251f26b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.836175 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3578960a-218e-419f-93f5-85a93251f26b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.873441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-f701bddc-c9c3-4ec0-accf-57f37ddf3a1b req-27bb40ef-2068-44d0-8a8c-617312a16ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f60a740-5f73-4d7e-b08b-982dfd3644fe", "tag": "80cf7af8-b656-4e21-a8fa-be6462313256"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:16.875353 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:16.875353 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:38:16.935022 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-f701bddc-c9c3-4ec0-accf-57f37ddf3a1b req-27bb40ef-2068-44d0-8a8c-617312a16ef9 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:16.935742 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-f701bddc-c9c3-4ec0-accf-57f37ddf3a1b req-27bb40ef-2068-44d0-8a8c-617312a16ef9 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:16.953124 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-f701bddc-c9c3-4ec0-accf-57f37ddf3a1b req-27bb40ef-2068-44d0-8a8c-617312a16ef9 service nova] Creating event network-changed:80cf7af8-b656-4e21-a8fa-be6462313256 for instance 1f60a740-5f73-4d7e-b08b-982dfd3644fe on hv-cinder-81322 Dec 15 13:38:16.962863 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-f701bddc-c9c3-4ec0-accf-57f37ddf3a1b req-27bb40ef-2068-44d0-8a8c-617312a16ef9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095806 Dec 15 13:38:16.966576 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 137/269] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:17.166181 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3578960a-218e-419f-93f5-85a93251f26b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:17.173496 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:17.174073 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3578960a-218e-419f-93f5-85a93251f26b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.365119 Dec 15 13:38:17.175848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 133/270] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:16 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:17.177042 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:17.191751 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:17.192458 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:17.193426 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:17.193957 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:17.380679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:17.390969 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:17.393941 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:17.395953 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2cf9e1c1-b6ec-487d-8c55-8c7b8c538b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.229861 Dec 15 13:38:17.396974 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 138/271] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:17 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:17.843261 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c241681c-5525-48e3-8991-f6c20210ecb4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:17.844043 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c241681c-5525-48e3-8991-f6c20210ecb4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:17.864861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c241681c-5525-48e3-8991-f6c20210ecb4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:17.872514 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c241681c-5525-48e3-8991-f6c20210ecb4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:17.873349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c241681c-5525-48e3-8991-f6c20210ecb4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:17.873837 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c241681c-5525-48e3-8991-f6c20210ecb4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:18.134755 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c241681c-5525-48e3-8991-f6c20210ecb4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:18.158435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c241681c-5525-48e3-8991-f6c20210ecb4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.318447 Dec 15 13:38:18.159440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 134/272] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:17 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:18.192249 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7bf224c4-2648-4799-a228-33facc21b891 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:18.192915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7bf224c4-2648-4799-a228-33facc21b891 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:18.202401 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7bf224c4-2648-4799-a228-33facc21b891 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:18.202846 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7bf224c4-2648-4799-a228-33facc21b891 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:18.206157 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7bf224c4-2648-4799-a228-33facc21b891 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:18.206646 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7bf224c4-2648-4799-a228-33facc21b891 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:18.387164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7bf224c4-2648-4799-a228-33facc21b891 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:18.400998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7bf224c4-2648-4799-a228-33facc21b891 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.212312 Dec 15 13:38:18.402605 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 139/273] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:18 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:18.424880 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:18.425446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:18.431874 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:18.432328 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:18.433130 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:18.433836 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:18.658381 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:18.671745 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:18.677002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:18.681279 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8593161f-00a3-4478-9228-63ad6c23028c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.259520 Dec 15 13:38:18.693063 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 135/274] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:18 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:19.177911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2234a6b7-38ea-4340-9a3f-7f759048fbad tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:19.178530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2234a6b7-38ea-4340-9a3f-7f759048fbad tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:19.184378 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2234a6b7-38ea-4340-9a3f-7f759048fbad tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:19.184792 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2234a6b7-38ea-4340-9a3f-7f759048fbad tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:19.185573 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2234a6b7-38ea-4340-9a3f-7f759048fbad tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:19.186035 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2234a6b7-38ea-4340-9a3f-7f759048fbad tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:19.357556 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2234a6b7-38ea-4340-9a3f-7f759048fbad tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:19.366503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2234a6b7-38ea-4340-9a3f-7f759048fbad tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.192500 Dec 15 13:38:19.367644 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 140/275] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:19 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:19.418559 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-148dfda2-bb48-4bb8-8993-7f31f515bce1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:19.419185 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-148dfda2-bb48-4bb8-8993-7f31f515bce1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:19.425500 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-148dfda2-bb48-4bb8-8993-7f31f515bce1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:19.429834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-148dfda2-bb48-4bb8-8993-7f31f515bce1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:19.429834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-148dfda2-bb48-4bb8-8993-7f31f515bce1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:19.429834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-148dfda2-bb48-4bb8-8993-7f31f515bce1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:19.564432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-148dfda2-bb48-4bb8-8993-7f31f515bce1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:19.572487 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-148dfda2-bb48-4bb8-8993-7f31f515bce1 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.157757 Dec 15 13:38:19.573257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 136/276] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:19 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:19.706497 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:19.706497 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:19.710893 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:19.711499 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:19.712743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:19.713170 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:19.864179 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:19.872860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:19.875503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:19.877105 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7636435e-2c1a-4d53-ac8a-1d3950cee659 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.177586 Dec 15 13:38:19.877989 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 141/277] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:19 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:20.386988 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-93957516-41c0-4756-bbeb-4c0717360c66 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:20.387585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-93957516-41c0-4756-bbeb-4c0717360c66 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:20.393156 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-93957516-41c0-4756-bbeb-4c0717360c66 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:20.393598 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-93957516-41c0-4756-bbeb-4c0717360c66 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:20.394392 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-93957516-41c0-4756-bbeb-4c0717360c66 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:20.394818 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-93957516-41c0-4756-bbeb-4c0717360c66 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:20.525938 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-93957516-41c0-4756-bbeb-4c0717360c66 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:20.533243 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-93957516-41c0-4756-bbeb-4c0717360c66 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.150522 Dec 15 13:38:20.534099 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 137/278] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:20 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:20.590687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9e87add4-f8f1-423b-a2f5-0d9268f2b079 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:20.591342 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9e87add4-f8f1-423b-a2f5-0d9268f2b079 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:20.597626 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9e87add4-f8f1-423b-a2f5-0d9268f2b079 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:20.598095 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9e87add4-f8f1-423b-a2f5-0d9268f2b079 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:20.598858 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9e87add4-f8f1-423b-a2f5-0d9268f2b079 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:20.599279 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9e87add4-f8f1-423b-a2f5-0d9268f2b079 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:20.756942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9e87add4-f8f1-423b-a2f5-0d9268f2b079 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:20.764874 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9e87add4-f8f1-423b-a2f5-0d9268f2b079 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.178437 Dec 15 13:38:20.765464 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 142/279] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:20 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:20.895864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:20.896458 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:20.908245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:20.908245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:20.908245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:20.908245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:21.036145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:21.044716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:21.046251 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:21.047397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7e778cbf-c85d-4097-99e2-7c6e5d40e15e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.155231 Dec 15 13:38:21.047999 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 138/280] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:20 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:21.549516 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-72d36e10-4589-42ea-b250-6dc61c739953 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:21.550182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-72d36e10-4589-42ea-b250-6dc61c739953 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:21.556681 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72d36e10-4589-42ea-b250-6dc61c739953 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:21.557135 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72d36e10-4589-42ea-b250-6dc61c739953 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:21.558309 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72d36e10-4589-42ea-b250-6dc61c739953 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:21.558756 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72d36e10-4589-42ea-b250-6dc61c739953 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:21.726351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-72d36e10-4589-42ea-b250-6dc61c739953 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:21.734641 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-72d36e10-4589-42ea-b250-6dc61c739953 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.188562 Dec 15 13:38:21.735370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 143/281] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:21 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:21.781851 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-abfee5b7-d019-4a56-82d7-e0fbfa2553aa tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:21.782642 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-abfee5b7-d019-4a56-82d7-e0fbfa2553aa tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:21.799031 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-abfee5b7-d019-4a56-82d7-e0fbfa2553aa tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:21.799485 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-abfee5b7-d019-4a56-82d7-e0fbfa2553aa tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:21.800273 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-abfee5b7-d019-4a56-82d7-e0fbfa2553aa tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:21.800699 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-abfee5b7-d019-4a56-82d7-e0fbfa2553aa tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:21.961445 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-abfee5b7-d019-4a56-82d7-e0fbfa2553aa tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:21.970946 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-abfee5b7-d019-4a56-82d7-e0fbfa2553aa tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.192764 Dec 15 13:38:21.971981 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 139/282] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:21 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:22.066059 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:22.066771 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:22.073350 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.074251 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.075284 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.075865 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.268495 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:22.279161 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:22.282123 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:22.284025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c3ff55f2-0a31-4df2-8551-53ac249039d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.221584 Dec 15 13:38:22.297783 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 144/283] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:22 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:22.761465 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c77a6a91-e834-48ae-adc9-3ac506a8f529 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:22.768216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c77a6a91-e834-48ae-adc9-3ac506a8f529 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:22.779158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c77a6a91-e834-48ae-adc9-3ac506a8f529 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.780505 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c77a6a91-e834-48ae-adc9-3ac506a8f529 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.782305 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c77a6a91-e834-48ae-adc9-3ac506a8f529 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:22.782893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c77a6a91-e834-48ae-adc9-3ac506a8f529 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:22.921585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c77a6a91-e834-48ae-adc9-3ac506a8f529 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:22.928717 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c77a6a91-e834-48ae-adc9-3ac506a8f529 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.171708 Dec 15 13:38:22.929462 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 140/284] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:22 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:22.990162 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8aa8f123-497d-4801-8a09-d62164215cf6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:22.990853 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8aa8f123-497d-4801-8a09-d62164215cf6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:22.999433 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8aa8f123-497d-4801-8a09-d62164215cf6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.000500 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8aa8f123-497d-4801-8a09-d62164215cf6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.001392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8aa8f123-497d-4801-8a09-d62164215cf6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.001868 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8aa8f123-497d-4801-8a09-d62164215cf6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.146960 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-8aa8f123-497d-4801-8a09-d62164215cf6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:23.155131 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8aa8f123-497d-4801-8a09-d62164215cf6 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.169806 Dec 15 13:38:23.155692 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 145/285] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:22 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:23.303609 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:23.304528 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:23.311277 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.311721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.312626 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.313083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.461932 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:23.469866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:23.471580 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:23.472786 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9f528312-ad88-4861-99a0-3eb9e2c355da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.173205 Dec 15 13:38:23.473336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 141/286] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:23 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:23.945498 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7e38cead-ccbe-4ca0-b7af-b0c77e234c44 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:23.946289 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7e38cead-ccbe-4ca0-b7af-b0c77e234c44 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:23.952721 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e38cead-ccbe-4ca0-b7af-b0c77e234c44 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.953234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e38cead-ccbe-4ca0-b7af-b0c77e234c44 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:23.954103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e38cead-ccbe-4ca0-b7af-b0c77e234c44 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:23.954625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e38cead-ccbe-4ca0-b7af-b0c77e234c44 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:24.095784 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7e38cead-ccbe-4ca0-b7af-b0c77e234c44 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:24.106239 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7e38cead-ccbe-4ca0-b7af-b0c77e234c44 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.164211 Dec 15 13:38:24.109807 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 146/287] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:23 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:24.171691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-bb5f497b-3b39-468a-ace9-2e94a165ec56 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:24.172332 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-bb5f497b-3b39-468a-ace9-2e94a165ec56 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:24.178999 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bb5f497b-3b39-468a-ace9-2e94a165ec56 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:24.179695 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bb5f497b-3b39-468a-ace9-2e94a165ec56 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:24.180656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bb5f497b-3b39-468a-ace9-2e94a165ec56 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:24.181560 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bb5f497b-3b39-468a-ace9-2e94a165ec56 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:24.354239 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-bb5f497b-3b39-468a-ace9-2e94a165ec56 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:24.364444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-bb5f497b-3b39-468a-ace9-2e94a165ec56 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.196363 Dec 15 13:38:24.365479 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 142/288] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:24 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:24.492314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:24.492959 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:24.499011 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:24.499513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:24.500285 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:24.500717 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:24.637966 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:24.645685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:24.647210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:24.648352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0739d488-f479-4f25-9219-1371be6addae tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.160012 Dec 15 13:38:24.648904 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 147/289] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:24 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:25.123887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b728f4b8-f9a0-4d7b-9a53-08646d6da984 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:25.124301 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b728f4b8-f9a0-4d7b-9a53-08646d6da984 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:25.130709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b728f4b8-f9a0-4d7b-9a53-08646d6da984 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:25.131149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b728f4b8-f9a0-4d7b-9a53-08646d6da984 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:25.131935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b728f4b8-f9a0-4d7b-9a53-08646d6da984 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:25.132368 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b728f4b8-f9a0-4d7b-9a53-08646d6da984 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:25.264272 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b728f4b8-f9a0-4d7b-9a53-08646d6da984 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:25.271522 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b728f4b8-f9a0-4d7b-9a53-08646d6da984 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.151561 Dec 15 13:38:25.272070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 143/290] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:25 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:25.397797 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9aca6521-542f-4c67-87d3-1bfbd53937ae tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:25.398337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9aca6521-542f-4c67-87d3-1bfbd53937ae tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:25.404441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9aca6521-542f-4c67-87d3-1bfbd53937ae tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:25.405070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9aca6521-542f-4c67-87d3-1bfbd53937ae tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:25.405774 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9aca6521-542f-4c67-87d3-1bfbd53937ae tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:25.406206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9aca6521-542f-4c67-87d3-1bfbd53937ae tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:25.553977 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9aca6521-542f-4c67-87d3-1bfbd53937ae tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:25.562139 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9aca6521-542f-4c67-87d3-1bfbd53937ae tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.168007 Dec 15 13:38:25.562702 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 148/291] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:25 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:25.666998 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:25.667594 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:25.673344 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:25.673815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:25.674583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:25.675005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:25.813002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:25.820710 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:25.822270 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:25.823416 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8b2e13ce-e2db-4bac-bc63-d61832d21599 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.160723 Dec 15 13:38:25.823971 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 144/292] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:25 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:26.289832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4681a1af-842c-42f4-b5f6-0c6392014945 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:26.291233 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4681a1af-842c-42f4-b5f6-0c6392014945 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:26.298199 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4681a1af-842c-42f4-b5f6-0c6392014945 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:26.298648 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4681a1af-842c-42f4-b5f6-0c6392014945 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:26.299444 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4681a1af-842c-42f4-b5f6-0c6392014945 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:26.299882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4681a1af-842c-42f4-b5f6-0c6392014945 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:26.440410 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4681a1af-842c-42f4-b5f6-0c6392014945 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:26.447682 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4681a1af-842c-42f4-b5f6-0c6392014945 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.163051 Dec 15 13:38:26.448222 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 149/293] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:26 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:26.578633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-adf85494-fee1-4dbe-ab4b-0a354a9cd492 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:26.579231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-adf85494-fee1-4dbe-ab4b-0a354a9cd492 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:26.585442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-adf85494-fee1-4dbe-ab4b-0a354a9cd492 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:26.585946 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-adf85494-fee1-4dbe-ab4b-0a354a9cd492 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:26.586716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-adf85494-fee1-4dbe-ab4b-0a354a9cd492 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:26.587645 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-adf85494-fee1-4dbe-ab4b-0a354a9cd492 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:26.715158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-adf85494-fee1-4dbe-ab4b-0a354a9cd492 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:26.722294 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-adf85494-fee1-4dbe-ab4b-0a354a9cd492 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.147710 Dec 15 13:38:26.722854 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 145/294] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:26 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:26.844628 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:26.845222 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:26.851396 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:26.851839 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:26.853257 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:26.853686 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:26.987017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:26.996221 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:26.997836 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:26.999566 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-75a121c6-fae5-4b4c-bcea-c4b17a844904 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.160335 Dec 15 13:38:27.010832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 150/295] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:26 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:27.465501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-20615981-f8e7-4e7d-8962-698bd70f9286 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:27.466158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-20615981-f8e7-4e7d-8962-698bd70f9286 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:27.472626 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-20615981-f8e7-4e7d-8962-698bd70f9286 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:27.473532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-20615981-f8e7-4e7d-8962-698bd70f9286 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:27.474523 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-20615981-f8e7-4e7d-8962-698bd70f9286 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:27.474950 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-20615981-f8e7-4e7d-8962-698bd70f9286 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:27.681707 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-20615981-f8e7-4e7d-8962-698bd70f9286 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:27.693218 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-20615981-f8e7-4e7d-8962-698bd70f9286 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.232180 Dec 15 13:38:27.693804 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 146/296] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:27 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:27.740085 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-94b09cac-2ab7-4049-a04b-23b7666b5b93 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:27.740999 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-94b09cac-2ab7-4049-a04b-23b7666b5b93 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:27.754592 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-94b09cac-2ab7-4049-a04b-23b7666b5b93 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:27.755295 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-94b09cac-2ab7-4049-a04b-23b7666b5b93 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:27.756177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-94b09cac-2ab7-4049-a04b-23b7666b5b93 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:27.756743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-94b09cac-2ab7-4049-a04b-23b7666b5b93 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:27.905653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-94b09cac-2ab7-4049-a04b-23b7666b5b93 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:27.912862 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-94b09cac-2ab7-4049-a04b-23b7666b5b93 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.176834 Dec 15 13:38:27.913400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 151/297] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:27 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:28.019171 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:28.019900 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:28.027927 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.028876 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.029981 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.030628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.243948 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:28.252108 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:28.253603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:28.254789 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f9fba6f7-7e35-444a-a4c0-6251d389d39c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.239838 Dec 15 13:38:28.262506 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 147/298] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:28 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:28.711979 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4294c328-11eb-43ab-a9a8-b6b21b882ac9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:28.712708 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4294c328-11eb-43ab-a9a8-b6b21b882ac9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:28.720205 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4294c328-11eb-43ab-a9a8-b6b21b882ac9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.720646 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4294c328-11eb-43ab-a9a8-b6b21b882ac9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.721434 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4294c328-11eb-43ab-a9a8-b6b21b882ac9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.721915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4294c328-11eb-43ab-a9a8-b6b21b882ac9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.873987 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4294c328-11eb-43ab-a9a8-b6b21b882ac9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:28.881219 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4294c328-11eb-43ab-a9a8-b6b21b882ac9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.173654 Dec 15 13:38:28.881851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 152/299] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:28 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:28.929836 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7bf968e2-162f-45a4-be2e-23c74bbb2e70 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:28.930439 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7bf968e2-162f-45a4-be2e-23c74bbb2e70 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:28.937300 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bf968e2-162f-45a4-be2e-23c74bbb2e70 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.937726 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bf968e2-162f-45a4-be2e-23c74bbb2e70 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:28.938470 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bf968e2-162f-45a4-be2e-23c74bbb2e70 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:28.938900 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bf968e2-162f-45a4-be2e-23c74bbb2e70 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.087568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7bf968e2-162f-45a4-be2e-23c74bbb2e70 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:29.094852 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7bf968e2-162f-45a4-be2e-23c74bbb2e70 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.168773 Dec 15 13:38:29.095418 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 148/300] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:28 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:29.273257 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:29.274027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:29.297244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.297698 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.298523 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.298958 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.448842 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:29.456866 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:29.458397 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:29.459924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fa411104-6625-4c04-8a95-bed3a835c881 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1743 microversion: 2.20 time: 0.190597 Dec 15 13:38:29.461223 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 153/301] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:29 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1743 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:29.900905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d3876492-02a4-4bc8-9aa5-85e428686c4a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:29.901738 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d3876492-02a4-4bc8-9aa5-85e428686c4a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:29.910479 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d3876492-02a4-4bc8-9aa5-85e428686c4a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.911582 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d3876492-02a4-4bc8-9aa5-85e428686c4a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:29.912585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d3876492-02a4-4bc8-9aa5-85e428686c4a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:29.913117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d3876492-02a4-4bc8-9aa5-85e428686c4a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:30.113788 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-57acac60-6b88-4cba-bd7c-49af2075ea0b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:30.114407 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-57acac60-6b88-4cba-bd7c-49af2075ea0b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:30.125384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-57acac60-6b88-4cba-bd7c-49af2075ea0b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:30.125887 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-57acac60-6b88-4cba-bd7c-49af2075ea0b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:30.126765 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-57acac60-6b88-4cba-bd7c-49af2075ea0b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:30.127234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-57acac60-6b88-4cba-bd7c-49af2075ea0b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:30.131113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d3876492-02a4-4bc8-9aa5-85e428686c4a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.140514 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d3876492-02a4-4bc8-9aa5-85e428686c4a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.244392 Dec 15 13:38:30.141492 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 149/302] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:29 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:30.300298 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-57acac60-6b88-4cba-bd7c-49af2075ea0b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.309448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-57acac60-6b88-4cba-bd7c-49af2075ea0b tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.199254 Dec 15 13:38:30.310632 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 154/303] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:30 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:30.479803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:30.481333 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:30.501242 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:30.501692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:30.502681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:30.503256 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:30.692996 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.700893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.703074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:30.704641 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2d70ddba-1b88-4b1d-ab99-19006c5263ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1743 microversion: 2.20 time: 0.228536 Dec 15 13:38:30.705267 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 150/304] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:30 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:31.160676 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-43bd4b37-c720-4fbd-811f-03f733bf7fe4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:31.162904 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-43bd4b37-c720-4fbd-811f-03f733bf7fe4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:31.181643 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-43bd4b37-c720-4fbd-811f-03f733bf7fe4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:31.182179 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-43bd4b37-c720-4fbd-811f-03f733bf7fe4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:31.183016 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-43bd4b37-c720-4fbd-811f-03f733bf7fe4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:31.183447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-43bd4b37-c720-4fbd-811f-03f733bf7fe4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:31.343215 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-48829932-0b38-4195-9878-9d0104409bbe tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:31.344629 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-48829932-0b38-4195-9878-9d0104409bbe tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:31.352068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-48829932-0b38-4195-9878-9d0104409bbe tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:31.353412 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-48829932-0b38-4195-9878-9d0104409bbe tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:31.354969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-48829932-0b38-4195-9878-9d0104409bbe tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:31.355618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-48829932-0b38-4195-9878-9d0104409bbe tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:31.455847 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-43bd4b37-c720-4fbd-811f-03f733bf7fe4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:31.469473 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-43bd4b37-c720-4fbd-811f-03f733bf7fe4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.309748 Dec 15 13:38:31.470351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 155/305] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:31 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:31.585416 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-48829932-0b38-4195-9878-9d0104409bbe tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:31.596308 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-48829932-0b38-4195-9878-9d0104409bbe tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.262045 Dec 15 13:38:31.596926 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 151/306] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:31 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:31.723688 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:31.725052 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:31.732052 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:31.732491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:31.733445 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:31.734046 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:31.986079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:32.012966 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:32.024215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:32.025655 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-595e0f24-c77b-4d7a-83dc-03be9a504154 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.305653 Dec 15 13:38:32.035571 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 156/307] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:31 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:32.488342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4b90470c-822a-4b09-b60b-423e601fb977 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:32.489710 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4b90470c-822a-4b09-b60b-423e601fb977 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:32.498293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4b90470c-822a-4b09-b60b-423e601fb977 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.499332 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4b90470c-822a-4b09-b60b-423e601fb977 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.500355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4b90470c-822a-4b09-b60b-423e601fb977 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.501033 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4b90470c-822a-4b09-b60b-423e601fb977 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.620197 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-63e75bcb-ad69-4e0b-be41-713e3170aa6a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:32.621312 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-63e75bcb-ad69-4e0b-be41-713e3170aa6a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:32.654950 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-63e75bcb-ad69-4e0b-be41-713e3170aa6a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.655681 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-63e75bcb-ad69-4e0b-be41-713e3170aa6a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.656970 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-63e75bcb-ad69-4e0b-be41-713e3170aa6a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.660176 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-63e75bcb-ad69-4e0b-be41-713e3170aa6a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.861495 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4b90470c-822a-4b09-b60b-423e601fb977 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:32.878176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4b90470c-822a-4b09-b60b-423e601fb977 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1501 microversion: 2.1 time: 0.394339 Dec 15 13:38:32.880632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 152/308] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:32 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1501 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:32.900667 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20af530b-37a7-4b83-ad75-553acb448807"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:32.902514 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:32.912779 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.913592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.915702 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:32.916789 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:32.974985 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] HTTP exception thrown: Cannot 'attach_volume' instance f53bb255-30a9-4c8c-b637-c9f371b04944 while it is in vm_state rescued Dec 15 13:38:32.975926 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Returning 409 to user: Cannot 'attach_volume' instance f53bb255-30a9-4c8c-b637-c9f371b04944 while it is in vm_state rescued {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:38:32.976983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-de9eb1f7-38ec-4a37-af99-80a9af9e4ac4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.081400 Dec 15 13:38:32.979342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 153/309] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:38:32 2021] POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments => generated 152 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 13:38:32.993223 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-837624f4-f972-4571-837a-180a3b18e2e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:32.994659 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-837624f4-f972-4571-837a-180a3b18e2e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:33.012653 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-837624f4-f972-4571-837a-180a3b18e2e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.013533 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-837624f4-f972-4571-837a-180a3b18e2e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.014725 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-837624f4-f972-4571-837a-180a3b18e2e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.015493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-837624f4-f972-4571-837a-180a3b18e2e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.023277 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-63e75bcb-ad69-4e0b-be41-713e3170aa6a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.032812 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-63e75bcb-ad69-4e0b-be41-713e3170aa6a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.419843 Dec 15 13:38:33.043339 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 157/310] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:32 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:33.048387 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-4de3f180-2474-4d5b-80e0-e70beca0f907 req-bee208b2-b7a6-4c2b-bdbd-1fd1bb84ae94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16af4c97-7ce7-47dd-8493-24d19a46221d", "name": "network-vif-plugged", "status": "completed", "tag": "e4b8c97b-020a-4806-8f09-f876ba55ad9d"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:33.050448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:33.050448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:38:33.058524 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-4de3f180-2474-4d5b-80e0-e70beca0f907 req-bee208b2-b7a6-4c2b-bdbd-1fd1bb84ae94 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.059289 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-4de3f180-2474-4d5b-80e0-e70beca0f907 req-bee208b2-b7a6-4c2b-bdbd-1fd1bb84ae94 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.093573 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-4de3f180-2474-4d5b-80e0-e70beca0f907 req-bee208b2-b7a6-4c2b-bdbd-1fd1bb84ae94 service nova] Creating event network-vif-plugged:e4b8c97b-020a-4806-8f09-f876ba55ad9d for instance 16af4c97-7ce7-47dd-8493-24d19a46221d on hv-cinder-81322 Dec 15 13:38:33.100857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-4de3f180-2474-4d5b-80e0-e70beca0f907 req-bee208b2-b7a6-4c2b-bdbd-1fd1bb84ae94 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055907 Dec 15 13:38:33.101860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 158/311] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:33.107641 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:33.109097 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:33.115929 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.116625 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-837624f4-f972-4571-837a-180a3b18e2e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/action" status: 202 len: 0 microversion: 2.1 time: 0.131927 Dec 15 13:38:33.116988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.117295 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 154/312] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:38:32 2021] POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:38:33.120488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.120488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.129513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f7d078f8-94c5-4d81-a689-954c84c5001d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:33.130505 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f7d078f8-94c5-4d81-a689-954c84c5001d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:33.140231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f7d078f8-94c5-4d81-a689-954c84c5001d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.141875 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f7d078f8-94c5-4d81-a689-954c84c5001d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.153924 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f7d078f8-94c5-4d81-a689-954c84c5001d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:33.154649 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f7d078f8-94c5-4d81-a689-954c84c5001d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:33.431458 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.449135 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.453293 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.460103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cea0b07c-f603-487b-bb33-ba3c06f6ada2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.356631 Dec 15 13:38:33.461747 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 159/313] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:33 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:33.481489 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f7d078f8-94c5-4d81-a689-954c84c5001d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:33.496541 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f7d078f8-94c5-4d81-a689-954c84c5001d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1509 microversion: 2.1 time: 0.374424 Dec 15 13:38:33.509628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 155/314] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:33 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1509 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:34.052352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-11637ba0-a2cb-4de1-b858-d8d94d033f81 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:34.052352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-11637ba0-a2cb-4de1-b858-d8d94d033f81 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:34.066243 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-11637ba0-a2cb-4de1-b858-d8d94d033f81 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.066705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-11637ba0-a2cb-4de1-b858-d8d94d033f81 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.080180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-11637ba0-a2cb-4de1-b858-d8d94d033f81 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.081056 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-11637ba0-a2cb-4de1-b858-d8d94d033f81 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.229543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-11637ba0-a2cb-4de1-b858-d8d94d033f81 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.237051 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-11637ba0-a2cb-4de1-b858-d8d94d033f81 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.190644 Dec 15 13:38:34.237614 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 160/315] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:34 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:34.481692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:34.482305 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:34.489155 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.489976 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.491896 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.492342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.516817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e4736186-ca7b-450d-b115-e7f0a5e1bda1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:34.517622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e4736186-ca7b-450d-b115-e7f0a5e1bda1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:34.523934 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e4736186-ca7b-450d-b115-e7f0a5e1bda1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.524876 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e4736186-ca7b-450d-b115-e7f0a5e1bda1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.526287 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e4736186-ca7b-450d-b115-e7f0a5e1bda1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:34.526963 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e4736186-ca7b-450d-b115-e7f0a5e1bda1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:34.751027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e4736186-ca7b-450d-b115-e7f0a5e1bda1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.765314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e4736186-ca7b-450d-b115-e7f0a5e1bda1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1509 microversion: 2.1 time: 0.253140 Dec 15 13:38:34.765953 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.766876 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 161/316] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:34 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:34.774140 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.776590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:34.778041 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ab2e184d-7049-49ad-8cb2-96d55c91919a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.301067 Dec 15 13:38:34.778839 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 156/317] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:34 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:35.149601 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-4fe8d2cb-2c9e-460b-89aa-c4cdaf703eb6 req-013c7672-cb50-493f-a843-ff4b06d83197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f60a740-5f73-4d7e-b08b-982dfd3644fe", "name": "network-vif-plugged", "status": "completed", "tag": "80cf7af8-b656-4e21-a8fa-be6462313256"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:35.151208 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:35.151208 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:38:35.159280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-4fe8d2cb-2c9e-460b-89aa-c4cdaf703eb6 req-013c7672-cb50-493f-a843-ff4b06d83197 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.159720 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-4fe8d2cb-2c9e-460b-89aa-c4cdaf703eb6 req-013c7672-cb50-493f-a843-ff4b06d83197 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.172599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-4fe8d2cb-2c9e-460b-89aa-c4cdaf703eb6 req-013c7672-cb50-493f-a843-ff4b06d83197 service nova] Creating event network-vif-plugged:80cf7af8-b656-4e21-a8fa-be6462313256 for instance 1f60a740-5f73-4d7e-b08b-982dfd3644fe on hv-cinder-81322 Dec 15 13:38:35.178218 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-4fe8d2cb-2c9e-460b-89aa-c4cdaf703eb6 req-013c7672-cb50-493f-a843-ff4b06d83197 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Dec 15 13:38:35.179098 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 162/318] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:35.254108 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d59f5f84-22fb-4498-94ae-3c49ee23bf0e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:35.255191 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d59f5f84-22fb-4498-94ae-3c49ee23bf0e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:35.261273 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d59f5f84-22fb-4498-94ae-3c49ee23bf0e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.261890 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d59f5f84-22fb-4498-94ae-3c49ee23bf0e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.262770 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d59f5f84-22fb-4498-94ae-3c49ee23bf0e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.263296 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d59f5f84-22fb-4498-94ae-3c49ee23bf0e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.428869 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d59f5f84-22fb-4498-94ae-3c49ee23bf0e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:35.436956 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d59f5f84-22fb-4498-94ae-3c49ee23bf0e tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.186255 Dec 15 13:38:35.437949 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 157/319] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:35 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:35.784357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-edeeb670-8175-4972-8470-1e76ba86af27 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:35.785053 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-edeeb670-8175-4972-8470-1e76ba86af27 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:35.792615 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-edeeb670-8175-4972-8470-1e76ba86af27 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.793466 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-edeeb670-8175-4972-8470-1e76ba86af27 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.794528 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-edeeb670-8175-4972-8470-1e76ba86af27 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.795229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-edeeb670-8175-4972-8470-1e76ba86af27 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.799033 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:35.799629 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:35.807787 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.808231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:35.809016 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:35.809941 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:36.077691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:36.080235 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-edeeb670-8175-4972-8470-1e76ba86af27 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:36.089212 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-edeeb670-8175-4972-8470-1e76ba86af27 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1509 microversion: 2.1 time: 0.308840 Dec 15 13:38:36.092770 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:36.096799 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:36.099185 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e8d0f107-cc11-4ca1-859b-c86b4cd8abfe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.303317 Dec 15 13:38:36.100201 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 163/320] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:35 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:36.110397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 158/321] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:35 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:36.454935 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c9547019-6b30-4aeb-9bda-3d6628d75554 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:36.456471 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c9547019-6b30-4aeb-9bda-3d6628d75554 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:36.463455 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9547019-6b30-4aeb-9bda-3d6628d75554 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:36.464418 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9547019-6b30-4aeb-9bda-3d6628d75554 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:36.465412 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9547019-6b30-4aeb-9bda-3d6628d75554 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:36.466206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9547019-6b30-4aeb-9bda-3d6628d75554 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:36.623100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c9547019-6b30-4aeb-9bda-3d6628d75554 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:36.639357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c9547019-6b30-4aeb-9bda-3d6628d75554 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.188832 Dec 15 13:38:36.640632 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 164/322] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:36 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:37.107130 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-60254c4f-8cbd-4a2f-854e-b64a1b98298b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:37.108485 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-60254c4f-8cbd-4a2f-854e-b64a1b98298b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:37.114932 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-60254c4f-8cbd-4a2f-854e-b64a1b98298b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:37.121050 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:37.121914 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:37.127264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-60254c4f-8cbd-4a2f-854e-b64a1b98298b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:37.128411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-60254c4f-8cbd-4a2f-854e-b64a1b98298b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:37.130527 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:37.131161 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-60254c4f-8cbd-4a2f-854e-b64a1b98298b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:37.134363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:37.135180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:37.135624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:37.417531 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-60254c4f-8cbd-4a2f-854e-b64a1b98298b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:37.430830 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-60254c4f-8cbd-4a2f-854e-b64a1b98298b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1509 microversion: 2.1 time: 0.327262 Dec 15 13:38:37.441959 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 159/323] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:37 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:37.458626 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:37.476606 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:37.478954 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:37.480448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f8991d8b-5665-493e-8a7a-1e6fd9e0dcd1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.363994 Dec 15 13:38:37.492000 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 165/324] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:37 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:37.656520 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-561ac265-2597-4504-a2a9-837511b4b7f8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:37.657411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-561ac265-2597-4504-a2a9-837511b4b7f8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:37.663412 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-561ac265-2597-4504-a2a9-837511b4b7f8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:37.664065 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-561ac265-2597-4504-a2a9-837511b4b7f8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:37.665039 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-561ac265-2597-4504-a2a9-837511b4b7f8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:37.665661 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-561ac265-2597-4504-a2a9-837511b4b7f8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:37.830302 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-561ac265-2597-4504-a2a9-837511b4b7f8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:37.842473 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-561ac265-2597-4504-a2a9-837511b4b7f8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.189268 Dec 15 13:38:37.851514 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 160/325] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:37 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:38.454699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6f6ca5d0-a0fc-4a97-972b-e334eaffc582 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:38.455719 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6f6ca5d0-a0fc-4a97-972b-e334eaffc582 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:38.477071 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6f6ca5d0-a0fc-4a97-972b-e334eaffc582 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:38.481887 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6f6ca5d0-a0fc-4a97-972b-e334eaffc582 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:38.484425 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6f6ca5d0-a0fc-4a97-972b-e334eaffc582 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:38.486496 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6f6ca5d0-a0fc-4a97-972b-e334eaffc582 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:38.502522 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:38.503979 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:38.514093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:38.516137 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:38.519274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:38.521026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:38.714205 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6f6ca5d0-a0fc-4a97-972b-e334eaffc582 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:38.724409 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6f6ca5d0-a0fc-4a97-972b-e334eaffc582 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1509 microversion: 2.1 time: 0.278660 Dec 15 13:38:38.734928 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 166/326] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:38 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:38.739639 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-56345389", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2022049678", "security_groups": [{"name": "tempest-secgroup-smoke-1219894246"}], "block_device_mapping_v2": [{"uuid": "ff364c49-b661-4450-8f98-839e2a3515e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7bf9178e-ef91-4e23-a896-35ca60172592"}]}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:38.805537 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:38.815262 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:38.817211 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:38.823663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-12f12293-825c-45a0-9e69-42c23386124f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.326951 Dec 15 13:38:38.824551 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 161/327] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:38 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:38.866872 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.network.neutron [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] validate_networks() for [('7bf9178e-ef91-4e23-a896-35ca60172592', None, None, None, None, None)] {{(pid=122611) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:38:38.867755 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-968beddc-d068-405e-ad66-aaa4543ed01a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:38.868466 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-968beddc-d068-405e-ad66-aaa4543ed01a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:38.878054 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-968beddc-d068-405e-ad66-aaa4543ed01a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:38.878591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-968beddc-d068-405e-ad66-aaa4543ed01a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:38.879464 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-968beddc-d068-405e-ad66-aaa4543ed01a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:38.885436 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-968beddc-d068-405e-ad66-aaa4543ed01a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.177803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-968beddc-d068-405e-ad66-aaa4543ed01a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:39.188647 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-968beddc-d068-405e-ad66-aaa4543ed01a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.324664 Dec 15 13:38:39.189724 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 162/328] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:38 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:39.451328 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Flavor limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:38:39.451749 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Image limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:38:39.452474 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Flavor pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:38:39.452881 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Image pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:38:39.453283 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:38:39.463200 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.464029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.466135 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.466569 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.489363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for project c0da9050a08e442887ca8dc346374836. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:39.490936 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for user 7e3a3afdfc4c44a29d0f3df50a5ed2ac and project c0da9050a08e442887ca8dc346374836. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:39.562064 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Going to run 1 instances... {{(pid=122611) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:38:39.562064 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff364c49-b661-4450-8f98-839e2a3515e0',volume_size=None,volume_type=None)] {{(pid=122611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:38:39.743193 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a950b7ea-02be-4acb-beed-97ec0ce8ca9a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:39.744389 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a950b7ea-02be-4acb-beed-97ec0ce8ca9a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:39.752537 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a950b7ea-02be-4acb-beed-97ec0ce8ca9a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.753690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a950b7ea-02be-4acb-beed-97ec0ce8ca9a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.754734 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a950b7ea-02be-4acb-beed-97ec0ce8ca9a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.755325 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cbbb4dd1-a9df-4cb7-9b7a-8bf6bd212556 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.019224 Dec 15 13:38:39.755553 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a950b7ea-02be-4acb-beed-97ec0ce8ca9a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.755973 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 167/329] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:38:38 2021] POST /compute/v2.1/servers => generated 406 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:38:39.774114 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-69bc6139-74eb-4180-b0d1-622befe7215b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:39.778024 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-69bc6139-74eb-4180-b0d1-622befe7215b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:39.864585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-69bc6139-74eb-4180-b0d1-622befe7215b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:39.871311 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-69bc6139-74eb-4180-b0d1-622befe7215b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1093 microversion: 2.1 time: 0.106960 Dec 15 13:38:39.872388 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 168/330] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:39 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1093 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:39.876899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:39.877679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:39.889503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.890130 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:39.890940 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:39.891371 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:40.069880 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a950b7ea-02be-4acb-beed-97ec0ce8ca9a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:40.081062 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a950b7ea-02be-4acb-beed-97ec0ce8ca9a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1509 microversion: 2.1 time: 0.342685 Dec 15 13:38:40.081837 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 163/331] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:39 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:40.138084 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:40.151727 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:40.154054 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:40.155748 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fd0b9593-6172-4df6-be69-f9f2c4dddefe tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.282277 Dec 15 13:38:40.156558 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 169/332] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:39 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:40.207908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ca429d1a-67e3-42ba-9803-2bc4e3a7063d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:40.208881 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ca429d1a-67e3-42ba-9803-2bc4e3a7063d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:40.217093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ca429d1a-67e3-42ba-9803-2bc4e3a7063d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:40.217548 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ca429d1a-67e3-42ba-9803-2bc4e3a7063d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:40.218367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ca429d1a-67e3-42ba-9803-2bc4e3a7063d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:40.218982 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ca429d1a-67e3-42ba-9803-2bc4e3a7063d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:40.386595 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ca429d1a-67e3-42ba-9803-2bc4e3a7063d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:40.402355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ca429d1a-67e3-42ba-9803-2bc4e3a7063d tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.200309 Dec 15 13:38:40.412408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 164/333] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:40 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:40.892247 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-973a1081-6830-4f26-9971-74484c2a2646 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:40.893107 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-973a1081-6830-4f26-9971-74484c2a2646 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:40.901414 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-973a1081-6830-4f26-9971-74484c2a2646 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:40.902263 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-973a1081-6830-4f26-9971-74484c2a2646 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:40.903476 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-973a1081-6830-4f26-9971-74484c2a2646 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:40.904273 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-973a1081-6830-4f26-9971-74484c2a2646 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:40.973439 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-973a1081-6830-4f26-9971-74484c2a2646 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:40.987984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-973a1081-6830-4f26-9971-74484c2a2646 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1143 microversion: 2.1 time: 0.102692 Dec 15 13:38:40.998769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 170/334] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:40 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1143 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:41.099469 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ea9e666e-3c13-4d0b-84ac-92562f7c355c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:41.103810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ea9e666e-3c13-4d0b-84ac-92562f7c355c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:41.111153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ea9e666e-3c13-4d0b-84ac-92562f7c355c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:41.111712 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ea9e666e-3c13-4d0b-84ac-92562f7c355c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:41.112592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ea9e666e-3c13-4d0b-84ac-92562f7c355c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:41.113098 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ea9e666e-3c13-4d0b-84ac-92562f7c355c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:41.176337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:41.177059 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:41.184058 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:41.184593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:41.185435 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:41.185966 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:41.346076 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ea9e666e-3c13-4d0b-84ac-92562f7c355c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:41.354460 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ea9e666e-3c13-4d0b-84ac-92562f7c355c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1509 microversion: 2.1 time: 0.258643 Dec 15 13:38:41.364443 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 165/335] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:41 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:41.420449 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:41.423979 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-04774c4d-0bdf-4bdb-a803-ddcb97bc051a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:41.426828 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-04774c4d-0bdf-4bdb-a803-ddcb97bc051a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:41.438470 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-04774c4d-0bdf-4bdb-a803-ddcb97bc051a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:41.438933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-04774c4d-0bdf-4bdb-a803-ddcb97bc051a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:41.439065 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:41.440647 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:41.441349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-04774c4d-0bdf-4bdb-a803-ddcb97bc051a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:41.442290 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1a074eef-5258-402e-8cd9-30c41351e40e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.269523 Dec 15 13:38:41.442708 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 171/336] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:41 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:41.443005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-04774c4d-0bdf-4bdb-a803-ddcb97bc051a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:41.610215 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-04774c4d-0bdf-4bdb-a803-ddcb97bc051a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:41.619644 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-04774c4d-0bdf-4bdb-a803-ddcb97bc051a tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.202354 Dec 15 13:38:41.620223 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 166/337] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:41 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:42.006070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-089c6412-433c-46cc-8dbe-9af4a6cc6847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:42.007256 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-089c6412-433c-46cc-8dbe-9af4a6cc6847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:42.022795 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-089c6412-433c-46cc-8dbe-9af4a6cc6847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:42.023532 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-089c6412-433c-46cc-8dbe-9af4a6cc6847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.024577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-089c6412-433c-46cc-8dbe-9af4a6cc6847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:42.025163 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-089c6412-433c-46cc-8dbe-9af4a6cc6847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.112148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-089c6412-433c-46cc-8dbe-9af4a6cc6847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:42.120957 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-089c6412-433c-46cc-8dbe-9af4a6cc6847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1143 microversion: 2.1 time: 0.118469 Dec 15 13:38:42.127065 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 172/338] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:42 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1143 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:42.372692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-55636987-11cf-46ef-b6a1-9cebc1fe59e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:42.373431 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-55636987-11cf-46ef-b6a1-9cebc1fe59e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:42.380827 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-55636987-11cf-46ef-b6a1-9cebc1fe59e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:42.381269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-55636987-11cf-46ef-b6a1-9cebc1fe59e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.389090 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-55636987-11cf-46ef-b6a1-9cebc1fe59e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:42.389590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-55636987-11cf-46ef-b6a1-9cebc1fe59e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.471143 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:42.472172 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:42.479230 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:42.480038 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.480991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:42.481640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.569609 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-55636987-11cf-46ef-b6a1-9cebc1fe59e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:42.578365 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-55636987-11cf-46ef-b6a1-9cebc1fe59e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1509 microversion: 2.1 time: 0.210253 Dec 15 13:38:42.579268 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 167/339] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:42 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:42.638487 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2fa3b965-4baf-4a7e-8ee6-cbdf4a4d2748 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:42.639221 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2fa3b965-4baf-4a7e-8ee6-cbdf4a4d2748 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:42.664847 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2fa3b965-4baf-4a7e-8ee6-cbdf4a4d2748 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:42.665432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2fa3b965-4baf-4a7e-8ee6-cbdf4a4d2748 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.666304 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2fa3b965-4baf-4a7e-8ee6-cbdf4a4d2748 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:42.668622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2fa3b965-4baf-4a7e-8ee6-cbdf4a4d2748 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:42.919919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:42.929255 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:42.942193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:42.944809 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-eba9e479-0d75-4826-ae7a-2c1bc38889bd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.476414 Dec 15 13:38:42.962996 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 173/340] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:42 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:43.081318 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2fa3b965-4baf-4a7e-8ee6-cbdf4a4d2748 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:43.090194 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2fa3b965-4baf-4a7e-8ee6-cbdf4a4d2748 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1314 microversion: 2.1 time: 0.456124 Dec 15 13:38:43.090954 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 168/341] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:42 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:43.138077 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-69d4a37f-72cc-4e8a-aac0-324268d97356 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:43.138859 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-69d4a37f-72cc-4e8a-aac0-324268d97356 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:43.148718 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-69d4a37f-72cc-4e8a-aac0-324268d97356 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:43.153782 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-69d4a37f-72cc-4e8a-aac0-324268d97356 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:43.154739 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-69d4a37f-72cc-4e8a-aac0-324268d97356 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:43.155298 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-69d4a37f-72cc-4e8a-aac0-324268d97356 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:43.260520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-69d4a37f-72cc-4e8a-aac0-324268d97356 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:43.273729 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-69d4a37f-72cc-4e8a-aac0-324268d97356 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1209 microversion: 2.1 time: 0.139132 Dec 15 13:38:43.274631 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 174/342] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:43 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:43.595151 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d80fe84c-770c-49c9-bc56-10b335feb3f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:43.595785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d80fe84c-770c-49c9-bc56-10b335feb3f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:43.612886 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d80fe84c-770c-49c9-bc56-10b335feb3f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:43.613373 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d80fe84c-770c-49c9-bc56-10b335feb3f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:43.614386 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d80fe84c-770c-49c9-bc56-10b335feb3f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:43.614817 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d80fe84c-770c-49c9-bc56-10b335feb3f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:43.856986 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d80fe84c-770c-49c9-bc56-10b335feb3f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:43.867340 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d80fe84c-770c-49c9-bc56-10b335feb3f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1515 microversion: 2.1 time: 0.275916 Dec 15 13:38:43.868755 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 169/343] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:43 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:43.985646 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:43.986303 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:44.010864 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:44.011907 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:44.016203 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:44.016686 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:44.108306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-950fee6f-56cb-4899-9a51-28772b867575 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:44.108938 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-950fee6f-56cb-4899-9a51-28772b867575 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:44.115337 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-950fee6f-56cb-4899-9a51-28772b867575 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:44.115797 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-950fee6f-56cb-4899-9a51-28772b867575 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:44.116583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-950fee6f-56cb-4899-9a51-28772b867575 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:44.117012 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-950fee6f-56cb-4899-9a51-28772b867575 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:44.453150 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:44.465024 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:44.470671 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-950fee6f-56cb-4899-9a51-28772b867575 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:44.480546 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:44.481838 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-35bdf56c-253a-4da9-b502-0b5f6f8187a4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1738 microversion: 2.20 time: 0.515270 Dec 15 13:38:44.482416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 175/344] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:43 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1738 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:44.483708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-950fee6f-56cb-4899-9a51-28772b867575 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1497 microversion: 2.1 time: 0.378768 Dec 15 13:38:44.484463 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 170/345] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:44 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1497 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:44.490098 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-22e9c632-d3c4-4e7e-9ce3-238673dc6b00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:44.491040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-22e9c632-d3c4-4e7e-9ce3-238673dc6b00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:44.504751 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-22e9c632-d3c4-4e7e-9ce3-238673dc6b00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:44.506179 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-22e9c632-d3c4-4e7e-9ce3-238673dc6b00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:44.507395 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-22e9c632-d3c4-4e7e-9ce3-238673dc6b00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:44.508034 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-22e9c632-d3c4-4e7e-9ce3-238673dc6b00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:44.695216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-22e9c632-d3c4-4e7e-9ce3-238673dc6b00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:44.708385 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-22e9c632-d3c4-4e7e-9ce3-238673dc6b00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.222586 Dec 15 13:38:44.709592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 171/346] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:44 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:45.102326 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-26bc6852-92e0-490e-9820-4f1bf889121c req-b645670e-c621-4752-91b7-bda757ea4823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa99337-9b29-41bc-90eb-cf4ffdbc2a44", "tag": "0387f3fb-6863-45ce-b5d6-5a1b21700b4b"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:45.105640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:45.105640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:38:45.116602 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-26bc6852-92e0-490e-9820-4f1bf889121c req-b645670e-c621-4752-91b7-bda757ea4823 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.117130 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-26bc6852-92e0-490e-9820-4f1bf889121c req-b645670e-c621-4752-91b7-bda757ea4823 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.139396 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-26bc6852-92e0-490e-9820-4f1bf889121c req-b645670e-c621-4752-91b7-bda757ea4823 service nova] Creating event network-changed:0387f3fb-6863-45ce-b5d6-5a1b21700b4b for instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 on hv-cinder-81322 Dec 15 13:38:45.154458 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-26bc6852-92e0-490e-9820-4f1bf889121c req-b645670e-c621-4752-91b7-bda757ea4823 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051393 Dec 15 13:38:45.155135 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 176/347] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:38:45.201581 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b861eb8d-d6b8-4f15-926c-870f42e09e2f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:45.205201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b861eb8d-d6b8-4f15-926c-870f42e09e2f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:45.224077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b861eb8d-d6b8-4f15-926c-870f42e09e2f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.224704 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b861eb8d-d6b8-4f15-926c-870f42e09e2f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.225656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b861eb8d-d6b8-4f15-926c-870f42e09e2f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.230434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b861eb8d-d6b8-4f15-926c-870f42e09e2f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.270272 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b861eb8d-d6b8-4f15-926c-870f42e09e2f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:38:45.420561 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b861eb8d-d6b8-4f15-926c-870f42e09e2f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 204 len: 0 microversion: 2.1 time: 0.222447 Dec 15 13:38:45.421496 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 172/348] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:38:45 2021] DELETE /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:38:45.430542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c1bea237-9db1-4dc9-b5ba-f1320eea1419 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:45.431766 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c1bea237-9db1-4dc9-b5ba-f1320eea1419 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:45.438383 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c1bea237-9db1-4dc9-b5ba-f1320eea1419 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.438828 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c1bea237-9db1-4dc9-b5ba-f1320eea1419 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.439991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c1bea237-9db1-4dc9-b5ba-f1320eea1419 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.440609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c1bea237-9db1-4dc9-b5ba-f1320eea1419 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.503455 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:45.508870 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:45.539601 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.540356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.551135 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.553668 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.870185 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:45.881420 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c1bea237-9db1-4dc9-b5ba-f1320eea1419 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:45.890232 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c1bea237-9db1-4dc9-b5ba-f1320eea1419 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1503 microversion: 2.1 time: 0.464323 Dec 15 13:38:45.892933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:45.894713 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 177/349] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:45 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1503 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:45.897397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:45.898862 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0638c3a3-0ede-4ec9-a921-57058b34a528 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1720 microversion: 2.20 time: 0.402209 Dec 15 13:38:45.903596 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 173/350] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:45 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1720 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:45.908289 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cdee5936-09e2-4f50-9145-431e07fb40c8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:45.909437 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cdee5936-09e2-4f50-9145-431e07fb40c8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:45.916336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e9d69f8c-f0fb-4991-b255-7df3b5cd8cb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:45.918157 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e9d69f8c-f0fb-4991-b255-7df3b5cd8cb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:45.924873 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cdee5936-09e2-4f50-9145-431e07fb40c8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.926258 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cdee5936-09e2-4f50-9145-431e07fb40c8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.927720 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e9d69f8c-f0fb-4991-b255-7df3b5cd8cb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.928171 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e9d69f8c-f0fb-4991-b255-7df3b5cd8cb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.928733 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cdee5936-09e2-4f50-9145-431e07fb40c8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.929308 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e9d69f8c-f0fb-4991-b255-7df3b5cd8cb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:45.929569 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cdee5936-09e2-4f50-9145-431e07fb40c8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:45.930077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e9d69f8c-f0fb-4991-b255-7df3b5cd8cb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:46.245729 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e9d69f8c-f0fb-4991-b255-7df3b5cd8cb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:46.250725 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-cdee5936-09e2-4f50-9145-431e07fb40c8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:46.260523 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e9d69f8c-f0fb-4991-b255-7df3b5cd8cb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1515 microversion: 2.1 time: 0.354101 Dec 15 13:38:46.260765 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cdee5936-09e2-4f50-9145-431e07fb40c8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.364589 Dec 15 13:38:46.261224 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 178/351] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:45 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:46.272669 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 174/352] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:45 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:46.277059 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f0c62f3c-cb04-4733-8791-f76bae12b086 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "870c8e99-4460-4113-89eb-2894e3aa750c"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:46.278221 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f0c62f3c-cb04-4733-8791-f76bae12b086 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:46.284175 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f3c-cb04-4733-8791-f76bae12b086 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:46.284634 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f3c-cb04-4733-8791-f76bae12b086 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:46.285407 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f3c-cb04-4733-8791-f76bae12b086 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:46.286033 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f3c-cb04-4733-8791-f76bae12b086 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:46.910820 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d7085173-c1a1-49ae-9a5c-1124191747ad tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:46.911491 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d7085173-c1a1-49ae-9a5c-1124191747ad tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:46.918194 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7085173-c1a1-49ae-9a5c-1124191747ad tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:46.918642 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7085173-c1a1-49ae-9a5c-1124191747ad tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:46.919437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7085173-c1a1-49ae-9a5c-1124191747ad tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:46.919850 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d7085173-c1a1-49ae-9a5c-1124191747ad tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:47.082865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d7085173-c1a1-49ae-9a5c-1124191747ad tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:47.090556 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d7085173-c1a1-49ae-9a5c-1124191747ad tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1503 microversion: 2.1 time: 0.183529 Dec 15 13:38:47.091123 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 175/353] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:46 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:47.104714 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:47.105605 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:47.111176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:47.111861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:47.112870 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:47.113639 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:47.350031 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:47.358299 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:47.360106 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:47.361285 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2b9ede84-b35e-47e4-ab3f-330a87b2c3d8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1720 microversion: 2.20 time: 0.269242 Dec 15 13:38:47.361863 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 176/354] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:47 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:47.366047 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b8a47fb4-246b-4db8-8839-2e00af34fd75 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:47.366635 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b8a47fb4-246b-4db8-8839-2e00af34fd75 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:47.372398 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b8a47fb4-246b-4db8-8839-2e00af34fd75 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:47.372840 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b8a47fb4-246b-4db8-8839-2e00af34fd75 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:47.373639 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b8a47fb4-246b-4db8-8839-2e00af34fd75 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:47.374264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b8a47fb4-246b-4db8-8839-2e00af34fd75 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:47.544086 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b8a47fb4-246b-4db8-8839-2e00af34fd75 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:47.552015 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b8a47fb4-246b-4db8-8839-2e00af34fd75 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.189104 Dec 15 13:38:47.552779 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 177/355] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:47 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:48.109565 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cd4ebf6b-4595-4389-814c-99461fa3fdb9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:48.110273 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cd4ebf6b-4595-4389-814c-99461fa3fdb9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:48.116997 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd4ebf6b-4595-4389-814c-99461fa3fdb9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:48.117444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd4ebf6b-4595-4389-814c-99461fa3fdb9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:48.118275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd4ebf6b-4595-4389-814c-99461fa3fdb9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:48.119366 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd4ebf6b-4595-4389-814c-99461fa3fdb9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:48.271800 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cd4ebf6b-4595-4389-814c-99461fa3fdb9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:48.279887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cd4ebf6b-4595-4389-814c-99461fa3fdb9 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1503 microversion: 2.1 time: 0.174438 Dec 15 13:38:48.280467 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 178/356] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:48 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:48.382067 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:48.382866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:48.394182 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:48.394967 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:48.395920 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:48.396708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:48.572382 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:48.580832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:48.582387 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:48.583562 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9a6598e6-f379-4119-878b-12dee8e77fd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1720 microversion: 2.20 time: 0.206749 Dec 15 13:38:48.594109 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 179/357] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:48 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:48.600585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f5076b7f-3a4e-4db2-bdfb-4a5a6890f37b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:48.601304 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f5076b7f-3a4e-4db2-bdfb-4a5a6890f37b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:48.608840 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5076b7f-3a4e-4db2-bdfb-4a5a6890f37b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:48.609342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5076b7f-3a4e-4db2-bdfb-4a5a6890f37b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:48.610249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5076b7f-3a4e-4db2-bdfb-4a5a6890f37b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:48.610794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5076b7f-3a4e-4db2-bdfb-4a5a6890f37b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:48.794979 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f5076b7f-3a4e-4db2-bdfb-4a5a6890f37b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:48.803401 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f5076b7f-3a4e-4db2-bdfb-4a5a6890f37b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.206827 Dec 15 13:38:48.803986 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 180/358] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:48 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:49.211793 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-876712ba-772e-4ab0-bbad-e6ec591b176e req-c12f0dfc-9e59-4c58-a9dd-18c3f859328a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16af4c97-7ce7-47dd-8493-24d19a46221d", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b8c97b-020a-4806-8f09-f876ba55ad9d"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:49.213411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:49.213411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:38:49.221278 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-876712ba-772e-4ab0-bbad-e6ec591b176e req-c12f0dfc-9e59-4c58-a9dd-18c3f859328a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.221746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-876712ba-772e-4ab0-bbad-e6ec591b176e req-c12f0dfc-9e59-4c58-a9dd-18c3f859328a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.245552 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-876712ba-772e-4ab0-bbad-e6ec591b176e req-c12f0dfc-9e59-4c58-a9dd-18c3f859328a service nova] Creating event network-vif-unplugged:e4b8c97b-020a-4806-8f09-f876ba55ad9d for instance 16af4c97-7ce7-47dd-8493-24d19a46221d on hv-cinder-81322 Dec 15 13:38:49.253207 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-876712ba-772e-4ab0-bbad-e6ec591b176e req-c12f0dfc-9e59-4c58-a9dd-18c3f859328a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044694 Dec 15 13:38:49.254202 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 181/359] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:38:49.261026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f0c62f3c-cb04-4733-8791-f76bae12b086 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.987689 Dec 15 13:38:49.261990 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 179/360] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:38:46 2021] POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments => generated 194 bytes in 2989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:49.301224 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-efb88c04-8b86-42db-890b-9a83e7af0702 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:49.302254 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-efb88c04-8b86-42db-890b-9a83e7af0702 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:49.311686 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-efb88c04-8b86-42db-890b-9a83e7af0702 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.312570 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-efb88c04-8b86-42db-890b-9a83e7af0702 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.314012 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-efb88c04-8b86-42db-890b-9a83e7af0702 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.314641 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-efb88c04-8b86-42db-890b-9a83e7af0702 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.495783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-efb88c04-8b86-42db-890b-9a83e7af0702 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:49.503663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-efb88c04-8b86-42db-890b-9a83e7af0702 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1503 microversion: 2.1 time: 0.210094 Dec 15 13:38:49.504438 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 182/361] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:49 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:49.604320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:49.605014 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:49.612453 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.613131 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.614010 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.614448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.824179 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8dca0e97-983f-4e1b-bc88-3db7a880b233 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:49.826026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8dca0e97-983f-4e1b-bc88-3db7a880b233 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:49.834541 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8dca0e97-983f-4e1b-bc88-3db7a880b233 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.835312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8dca0e97-983f-4e1b-bc88-3db7a880b233 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.836341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8dca0e97-983f-4e1b-bc88-3db7a880b233 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:49.837039 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8dca0e97-983f-4e1b-bc88-3db7a880b233 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:49.851789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:49.871234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:49.873229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:49.875290 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-58b18ff6-54dd-41c6-9301-3655a66b6e34 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1720 microversion: 2.20 time: 0.275781 Dec 15 13:38:49.892072 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 180/362] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:49 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1720 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:50.104409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8dca0e97-983f-4e1b-bc88-3db7a880b233 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:50.113070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8dca0e97-983f-4e1b-bc88-3db7a880b233 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.294528 Dec 15 13:38:50.124337 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 183/363] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:49 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:50.523785 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c0698d29-e1e9-4875-a468-7ee375480d4f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:50.526063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c0698d29-e1e9-4875-a468-7ee375480d4f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:50.538215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c0698d29-e1e9-4875-a468-7ee375480d4f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:50.539128 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c0698d29-e1e9-4875-a468-7ee375480d4f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:50.546368 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c0698d29-e1e9-4875-a468-7ee375480d4f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:50.547594 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c0698d29-e1e9-4875-a468-7ee375480d4f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:50.872627 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c0698d29-e1e9-4875-a468-7ee375480d4f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66780c2cebcd40cfa78589c9b4cd4622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3823701b6f1423aa1ecd29bf162e5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:50.883954 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c0698d29-e1e9-4875-a468-7ee375480d4f tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 200 len: 1503 microversion: 2.1 time: 0.364936 Dec 15 13:38:50.887464 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 181/364] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:50 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:50.896619 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:50.897471 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:50.914428 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:50.917395 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:50.936300 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:50.938133 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:51.024878 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-17866da6-a72f-4fd7-83c2-839c95a4da43 req-7aa1ac2a-e1d9-4c30-b72c-07ccaf577bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f60a740-5f73-4d7e-b08b-982dfd3644fe", "name": "network-vif-deleted", "tag": "80cf7af8-b656-4e21-a8fa-be6462313256"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:51.027608 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:38:51.027608 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:38:51.036686 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-17866da6-a72f-4fd7-83c2-839c95a4da43 req-7aa1ac2a-e1d9-4c30-b72c-07ccaf577bf5 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:51.037585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-17866da6-a72f-4fd7-83c2-839c95a4da43 req-7aa1ac2a-e1d9-4c30-b72c-07ccaf577bf5 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:51.066890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-17866da6-a72f-4fd7-83c2-839c95a4da43 req-7aa1ac2a-e1d9-4c30-b72c-07ccaf577bf5 service nova] Creating event network-vif-deleted:80cf7af8-b656-4e21-a8fa-be6462313256 for instance 1f60a740-5f73-4d7e-b08b-982dfd3644fe on hv-cinder-81322 Dec 15 13:38:51.073148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-17866da6-a72f-4fd7-83c2-839c95a4da43 req-7aa1ac2a-e1d9-4c30-b72c-07ccaf577bf5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055494 Dec 15 13:38:51.074931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 182/365] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:38:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:38:51.132387 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d5ea3ebd-bbd5-4f3e-9b66-092754b47f71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:51.133180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d5ea3ebd-bbd5-4f3e-9b66-092754b47f71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:51.144885 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ebd-bbd5-4f3e-9b66-092754b47f71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:51.146503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ebd-bbd5-4f3e-9b66-092754b47f71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:51.154363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ebd-bbd5-4f3e-9b66-092754b47f71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:51.155073 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d5ea3ebd-bbd5-4f3e-9b66-092754b47f71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:51.200916 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:51.214987 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:51.216861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:51.221246 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b3f034e6-b9d5-4603-9086-ddbc1e6b45d5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1723 microversion: 2.20 time: 0.328580 Dec 15 13:38:51.231836 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 184/366] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:50 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:51.245937 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4cdc6fd9-b39a-43d9-8e82-d1cce35d6ee0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e7a4679-ace3-4ad0-af21-00afa0844071"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:51.247163 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4cdc6fd9-b39a-43d9-8e82-d1cce35d6ee0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:51.256651 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6fd9-b39a-43d9-8e82-d1cce35d6ee0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:51.257163 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6fd9-b39a-43d9-8e82-d1cce35d6ee0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:51.258288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6fd9-b39a-43d9-8e82-d1cce35d6ee0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:51.258730 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6fd9-b39a-43d9-8e82-d1cce35d6ee0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:51.392119 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d5ea3ebd-bbd5-4f3e-9b66-092754b47f71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:51.402243 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d5ea3ebd-bbd5-4f3e-9b66-092754b47f71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.273844 Dec 15 13:38:51.402828 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 183/367] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:51 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:51.833261 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4cdc6fd9-b39a-43d9-8e82-d1cce35d6ee0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.591541 Dec 15 13:38:51.836757 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 185/368] 10.222.0.83 () {62 vars in 1363 bytes} [Wed Dec 15 13:38:51 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments => generated 188 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:38:51.914593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:51.915881 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] [instance: 1f60a740-5f73-4d7e-b08b-982dfd3644fe] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:51.922326 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:51.923354 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:51.924663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:51.925436 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:51.945351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] HTTP exception thrown: Instance 1f60a740-5f73-4d7e-b08b-982dfd3644fe could not be found. Dec 15 13:38:51.946300 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] Returning 404 to user: Instance 1f60a740-5f73-4d7e-b08b-982dfd3644fe could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:38:51.947894 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5232bbcc-fa3a-4a97-94d5-9476640984d8 tempest-VolumesActionsTest-6933294 tempest-VolumesActionsTest-6933294-project] 10.222.0.83 "GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe" status: 404 len: 111 microversion: 2.1 time: 0.038822 Dec 15 13:38:51.952966 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 184/369] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:51 2021] GET /compute/v2.1/servers/1f60a740-5f73-4d7e-b08b-982dfd3644fe => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:38:52.095295 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-44db1f97-7861-48d5-ba22-0d4b283eb691 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:52.096797 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-44db1f97-7861-48d5-ba22-0d4b283eb691 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:52.114820 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44db1f97-7861-48d5-ba22-0d4b283eb691 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:52.115277 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44db1f97-7861-48d5-ba22-0d4b283eb691 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:52.116088 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44db1f97-7861-48d5-ba22-0d4b283eb691 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:52.121898 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44db1f97-7861-48d5-ba22-0d4b283eb691 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:52.303668 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-44db1f97-7861-48d5-ba22-0d4b283eb691 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action" status: 202 len: 0 microversion: 2.20 time: 0.212404 Dec 15 13:38:52.314851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:52.321008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:52.326147 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 186/370] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:38:52 2021] POST /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:38:52.330370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:52.331285 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:52.332299 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:52.333117 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:52.419722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1b812b4c-126a-4a34-bfe5-40b4bcebba63 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:52.421062 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1b812b4c-126a-4a34-bfe5-40b4bcebba63 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:52.427659 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1b812b4c-126a-4a34-bfe5-40b4bcebba63 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:52.428481 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1b812b4c-126a-4a34-bfe5-40b4bcebba63 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:52.429519 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1b812b4c-126a-4a34-bfe5-40b4bcebba63 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:52.430618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1b812b4c-126a-4a34-bfe5-40b4bcebba63 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:52.746061 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:52.771308 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:52.776487 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:52.780089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-72bdbeda-0ba5-42fc-9a31-46d58788b0db tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1749 microversion: 2.20 time: 0.470011 Dec 15 13:38:52.788118 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 185/371] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:52 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1749 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:38:52.932723 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1b812b4c-126a-4a34-bfe5-40b4bcebba63 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:52.942287 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1b812b4c-126a-4a34-bfe5-40b4bcebba63 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.527051 Dec 15 13:38:52.942971 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 187/372] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:52 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:53.804586 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:53.805731 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:53.816671 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:53.817262 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:53.818340 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:53.818774 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:53.972529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2d39303b-5b48-4179-9e57-9b6cb1b6a214 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:53.973145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2d39303b-5b48-4179-9e57-9b6cb1b6a214 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:53.985973 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d39303b-5b48-4179-9e57-9b6cb1b6a214 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:53.986426 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d39303b-5b48-4179-9e57-9b6cb1b6a214 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:53.987325 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d39303b-5b48-4179-9e57-9b6cb1b6a214 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:53.990106 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d39303b-5b48-4179-9e57-9b6cb1b6a214 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:54.173429 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:54.182566 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:54.185655 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:54.189159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ea15bef3-2eb8-42e8-94e0-620c73d193ac tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1749 microversion: 2.20 time: 0.388511 Dec 15 13:38:54.207239 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 186/373] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:53 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1749 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:54.264277 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2d39303b-5b48-4179-9e57-9b6cb1b6a214 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:54.271970 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2d39303b-5b48-4179-9e57-9b6cb1b6a214 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.303255 Dec 15 13:38:54.273522 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 188/374] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:53 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:55.220234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:55.221887 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:55.230513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:55.230964 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:55.231860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:55.232295 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:55.290188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-96729b1e-8110-43b2-87c6-100a5c6bf8a6 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:55.292633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-96729b1e-8110-43b2-87c6-100a5c6bf8a6 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:55.299952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-96729b1e-8110-43b2-87c6-100a5c6bf8a6 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:55.300663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-96729b1e-8110-43b2-87c6-100a5c6bf8a6 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:55.301600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-96729b1e-8110-43b2-87c6-100a5c6bf8a6 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:55.302201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-96729b1e-8110-43b2-87c6-100a5c6bf8a6 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:55.569024 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-96729b1e-8110-43b2-87c6-100a5c6bf8a6 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:55.580064 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-96729b1e-8110-43b2-87c6-100a5c6bf8a6 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.293364 Dec 15 13:38:55.580642 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 189/375] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:55 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:55.641101 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:55.654766 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:55.660789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:55.663457 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fbb0acea-0279-4a86-b6f3-97aade3cb36e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1749 microversion: 2.20 time: 0.453068 Dec 15 13:38:55.681672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 187/376] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:55 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1749 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:56.596489 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-82bf0c41-f599-4349-924f-37d4e457795f tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:56.602539 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-82bf0c41-f599-4349-924f-37d4e457795f tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:56.639349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-82bf0c41-f599-4349-924f-37d4e457795f tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:56.659491 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-82bf0c41-f599-4349-924f-37d4e457795f tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:56.660530 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-82bf0c41-f599-4349-924f-37d4e457795f tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:56.663846 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-82bf0c41-f599-4349-924f-37d4e457795f tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:56.686074 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:56.686632 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:56.698436 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:56.699019 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:56.699686 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:56.700105 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:57.061611 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:57.077088 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:57.077233 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-82bf0c41-f599-4349-924f-37d4e457795f tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:57.083017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:57.095646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-82bf0c41-f599-4349-924f-37d4e457795f tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.502882 Dec 15 13:38:57.096417 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 190/377] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:56 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:38:57.107384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-540e0c70-4f86-4c4f-89ad-c1dd405a18e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1751 microversion: 2.20 time: 0.424848 Dec 15 13:38:57.112862 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 188/378] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:56 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1751 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:38:58.002466 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1301088081", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:38:58.112342 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-42a4d779-2f25-493c-b1fd-96a15029089d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:58.113122 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-42a4d779-2f25-493c-b1fd-96a15029089d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:58.122870 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-42a4d779-2f25-493c-b1fd-96a15029089d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:58.132450 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-42a4d779-2f25-493c-b1fd-96a15029089d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:58.137133 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-42a4d779-2f25-493c-b1fd-96a15029089d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:58.137867 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-42a4d779-2f25-493c-b1fd-96a15029089d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:58.154423 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] validate_networks() for None {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:38:59.638836 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-42a4d779-2f25-493c-b1fd-96a15029089d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:38:59.650559 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-42a4d779-2f25-493c-b1fd-96a15029089d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 1.540097 Dec 15 13:38:59.651844 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 189/379] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:38:58 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:38:59.668024 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:38:59.674454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:38:59.686404 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.688905 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.690945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.694589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.773736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:38:59.774279 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:38:59.775440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:38:59.775951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:38:59.776461 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:38:59.804900 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.805356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.806277 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:38:59.806718 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:38:59.873327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Getting quotas for project 3b040f42f67e4061b728e00adb165e5d. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:38:59.885237 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Getting quotas for user bd856659215346d39dedfdb6648f90e8 and project 3b040f42f67e4061b728e00adb165e5d. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:38:59.917482 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:38:59.924502 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:39:00.024445 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-789c3037-8a6a-41c1-8c2c-255a7e444afc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.027109 Dec 15 13:39:00.029733 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 191/380] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:38:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:39:00.039167 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c6cdb211-346c-4859-b9fb-fc1afd1e5717 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:00.060497 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c6cdb211-346c-4859-b9fb-fc1afd1e5717 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:00.076173 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c6cdb211-346c-4859-b9fb-fc1afd1e5717 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.077067 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c6cdb211-346c-4859-b9fb-fc1afd1e5717 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.078566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c6cdb211-346c-4859-b9fb-fc1afd1e5717 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.079233 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c6cdb211-346c-4859-b9fb-fc1afd1e5717 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.126852 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-c6cdb211-346c-4859-b9fb-fc1afd1e5717 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'flavor' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:39:00.245988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:00.258707 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:00.268211 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:00.274618 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a23f939a-2353-4ac2-ad62-5a00dafcde03 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.615070 Dec 15 13:39:00.280140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 190/381] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:38:59 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:00.293384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-f6ac68d9-1ba9-4fc7-9e52-b0a98e957a35 req-00828380-b4d5-4856-ab19-344f79b45f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa99337-9b29-41bc-90eb-cf4ffdbc2a44", "name": "network-vif-plugged", "status": "completed", "tag": "0387f3fb-6863-45ce-b5d6-5a1b21700b4b"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:00.296814 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:00.296814 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:39:00.326787 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-f6ac68d9-1ba9-4fc7-9e52-b0a98e957a35 req-00828380-b4d5-4856-ab19-344f79b45f84 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.329564 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-f6ac68d9-1ba9-4fc7-9e52-b0a98e957a35 req-00828380-b4d5-4856-ab19-344f79b45f84 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.384023 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-f6ac68d9-1ba9-4fc7-9e52-b0a98e957a35 req-00828380-b4d5-4856-ab19-344f79b45f84 service nova] Creating event network-vif-plugged:0387f3fb-6863-45ce-b5d6-5a1b21700b4b for instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 on hv-cinder-81322 Dec 15 13:39:00.423936 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-f6ac68d9-1ba9-4fc7-9e52-b0a98e957a35 req-00828380-b4d5-4856-ab19-344f79b45f84 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133909 Dec 15 13:39:00.427303 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 191/382] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:00.460435 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-550c9711-286a-4baa-810f-80475a403d34 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:00.467062 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-550c9711-286a-4baa-810f-80475a403d34 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:00.480426 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c6cdb211-346c-4859-b9fb-fc1afd1e5717 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/action" status: 200 len: 32 microversion: 2.1 time: 0.448842 Dec 15 13:39:00.481279 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 192/383] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:00 2021] POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/action => generated 32 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:00.493768 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b91d40ac-d8d3-4e10-928f-e1b764c7b214 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:00.494757 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b91d40ac-d8d3-4e10-928f-e1b764c7b214 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:00.502973 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b91d40ac-d8d3-4e10-928f-e1b764c7b214 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.503806 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b91d40ac-d8d3-4e10-928f-e1b764c7b214 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.504840 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b91d40ac-d8d3-4e10-928f-e1b764c7b214 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.505692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b91d40ac-d8d3-4e10-928f-e1b764c7b214 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.774258 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-550c9711-286a-4baa-810f-80475a403d34 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:00.794124 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-550c9711-286a-4baa-810f-80475a403d34 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1215 microversion: 2.1 time: 0.362002 Dec 15 13:39:00.798552 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 192/384] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:00 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1215 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:00.815676 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ca18e080-048a-45c6-a7e3-146f16b133af tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:00.819200 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ca18e080-048a-45c6-a7e3-146f16b133af tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:00.833887 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ca18e080-048a-45c6-a7e3-146f16b133af tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.844114 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ca18e080-048a-45c6-a7e3-146f16b133af tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:00.845746 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ca18e080-048a-45c6-a7e3-146f16b133af tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:00.847081 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ca18e080-048a-45c6-a7e3-146f16b133af tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:01.622333 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b91d40ac-d8d3-4e10-928f-e1b764c7b214 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:01.665049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b91d40ac-d8d3-4e10-928f-e1b764c7b214 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 1.171288 Dec 15 13:39:01.671684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 193/385] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:00 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:01.687820 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:01.694546 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:01.727230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:01.728265 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:01.735156 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:01.739569 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:02.176578 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ca18e080-048a-45c6-a7e3-146f16b133af tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:02.191752 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ca18e080-048a-45c6-a7e3-146f16b133af tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 1.391801 Dec 15 13:39:02.193411 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 193/386] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:00 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:02.207025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7bb8b6fe-158a-4da5-a9ce-5da1ab5b5559 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:02.208158 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7bb8b6fe-158a-4da5-a9ce-5da1ab5b5559 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:02.218106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7bb8b6fe-158a-4da5-a9ce-5da1ab5b5559 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:02.218949 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7bb8b6fe-158a-4da5-a9ce-5da1ab5b5559 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:02.220086 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7bb8b6fe-158a-4da5-a9ce-5da1ab5b5559 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:02.220685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7bb8b6fe-158a-4da5-a9ce-5da1ab5b5559 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:02.491269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7bb8b6fe-158a-4da5-a9ce-5da1ab5b5559 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:02.515187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7bb8b6fe-158a-4da5-a9ce-5da1ab5b5559 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1267 microversion: 2.1 time: 0.320360 Dec 15 13:39:02.525215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 194/387] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:02 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:02.564918 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:02.574164 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:02.575665 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:02.576839 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7bcf4a23-e6d7-493b-a1fd-2887c245640c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.903287 Dec 15 13:39:02.577403 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 194/388] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:01 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:02.688669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-560fe531-7ce9-40e8-b014-4930e3512553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:02.690082 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-560fe531-7ce9-40e8-b014-4930e3512553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:02.703954 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-560fe531-7ce9-40e8-b014-4930e3512553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:02.705813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-560fe531-7ce9-40e8-b014-4930e3512553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:02.709961 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-560fe531-7ce9-40e8-b014-4930e3512553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:02.710640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-560fe531-7ce9-40e8-b014-4930e3512553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.210637 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-71f7e2c7-b678-4720-a652-6e5be4e43533 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:03.211291 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-71f7e2c7-b678-4720-a652-6e5be4e43533 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:03.229131 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-71f7e2c7-b678-4720-a652-6e5be4e43533 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.230004 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-71f7e2c7-b678-4720-a652-6e5be4e43533 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.231050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-71f7e2c7-b678-4720-a652-6e5be4e43533 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.231779 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-71f7e2c7-b678-4720-a652-6e5be4e43533 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.387704 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-560fe531-7ce9-40e8-b014-4930e3512553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:03.399727 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-560fe531-7ce9-40e8-b014-4930e3512553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.714618 Dec 15 13:39:03.403805 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 195/389] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:02 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:03.532401 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e688bb41-806a-462b-a7cb-a78ff33e0144 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:03.533116 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e688bb41-806a-462b-a7cb-a78ff33e0144 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:03.550917 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e688bb41-806a-462b-a7cb-a78ff33e0144 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.551478 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e688bb41-806a-462b-a7cb-a78ff33e0144 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.552362 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e688bb41-806a-462b-a7cb-a78ff33e0144 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.552867 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e688bb41-806a-462b-a7cb-a78ff33e0144 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.625247 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-71f7e2c7-b678-4720-a652-6e5be4e43533 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:03.681025 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-71f7e2c7-b678-4720-a652-6e5be4e43533 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1265 microversion: 2.1 time: 0.473863 Dec 15 13:39:03.682145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 195/390] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:03 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1265 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:03.689954 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:03.692126 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:03.701300 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.702386 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.704124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:03.705054 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:03.932927 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e688bb41-806a-462b-a7cb-a78ff33e0144 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:03.941411 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e688bb41-806a-462b-a7cb-a78ff33e0144 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1267 microversion: 2.1 time: 0.412695 Dec 15 13:39:03.943331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 196/391] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:03 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1267 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:04.422693 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7e577bff-8e4c-4891-a1ee-e8938a1f164a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:04.423452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7e577bff-8e4c-4891-a1ee-e8938a1f164a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:04.442890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e577bff-8e4c-4891-a1ee-e8938a1f164a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:04.443622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e577bff-8e4c-4891-a1ee-e8938a1f164a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:04.445577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e577bff-8e4c-4891-a1ee-e8938a1f164a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:04.450452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e577bff-8e4c-4891-a1ee-e8938a1f164a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:04.924075 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:04.944588 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:04.946250 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:04.948025 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d2622893-f335-4094-9613-78f9a2b34287 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 1.264768 Dec 15 13:39:04.948584 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 196/392] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:03 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:04.973121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-95a3f837-67ac-45bb-9f88-ef0385cc6b48 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:04.973739 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-95a3f837-67ac-45bb-9f88-ef0385cc6b48 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:04.996592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-95a3f837-67ac-45bb-9f88-ef0385cc6b48 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:04.996892 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-95a3f837-67ac-45bb-9f88-ef0385cc6b48 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:04.997715 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-95a3f837-67ac-45bb-9f88-ef0385cc6b48 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:04.998189 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-95a3f837-67ac-45bb-9f88-ef0385cc6b48 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:05.337089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7e577bff-8e4c-4891-a1ee-e8938a1f164a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:05.353013 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7e577bff-8e4c-4891-a1ee-e8938a1f164a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.937157 Dec 15 13:39:05.359411 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 197/393] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:04 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:05.368057 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f78bd2ad-e38a-4afa-b630-676dd2fb2e2c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:05.369214 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f78bd2ad-e38a-4afa-b630-676dd2fb2e2c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:05.418661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f78bd2ad-e38a-4afa-b630-676dd2fb2e2c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:05.419119 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f78bd2ad-e38a-4afa-b630-676dd2fb2e2c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:05.419925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f78bd2ad-e38a-4afa-b630-676dd2fb2e2c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:05.426745 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f78bd2ad-e38a-4afa-b630-676dd2fb2e2c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:05.672497 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f78bd2ad-e38a-4afa-b630-676dd2fb2e2c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:05.680739 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f78bd2ad-e38a-4afa-b630-676dd2fb2e2c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1273 microversion: 2.1 time: 0.319990 Dec 15 13:39:05.681372 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 198/394] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:05 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1273 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:05.692271 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-95a3f837-67ac-45bb-9f88-ef0385cc6b48 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:05.706039 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-95a3f837-67ac-45bb-9f88-ef0385cc6b48 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1452 microversion: 2.1 time: 0.755551 Dec 15 13:39:05.711460 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 197/395] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:04 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1452 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:05.730643 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5a648184-353d-4e26-8d99-ba193eb5cd6b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:05.731953 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5a648184-353d-4e26-8d99-ba193eb5cd6b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:05.755713 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5a648184-353d-4e26-8d99-ba193eb5cd6b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:05.758430 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5a648184-353d-4e26-8d99-ba193eb5cd6b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:05.761139 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5a648184-353d-4e26-8d99-ba193eb5cd6b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:05.766459 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5a648184-353d-4e26-8d99-ba193eb5cd6b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:05.967547 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:05.968334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:05.984756 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:05.988851 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:05.990040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:05.990666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:06.078644 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5a648184-353d-4e26-8d99-ba193eb5cd6b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:06.088899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5a648184-353d-4e26-8d99-ba193eb5cd6b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1452 microversion: 2.1 time: 0.363885 Dec 15 13:39:06.095881 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 199/396] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:05 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1452 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:06.443360 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:06.458931 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:06.460578 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:06.469262 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-12bc7bcd-f264-47b5-a2c2-06f6d99501f2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.505342 Dec 15 13:39:06.474119 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 198/397] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:05 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:39:06.490286 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f2ce3d0c-b5ad-461d-81e8-402d06018fb0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:06.497434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f2ce3d0c-b5ad-461d-81e8-402d06018fb0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:06.518573 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f2ce3d0c-b5ad-461d-81e8-402d06018fb0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:06.522016 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f2ce3d0c-b5ad-461d-81e8-402d06018fb0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:06.525709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f2ce3d0c-b5ad-461d-81e8-402d06018fb0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:06.527048 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f2ce3d0c-b5ad-461d-81e8-402d06018fb0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:06.712648 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-eda1cbc6-1df3-4422-89b6-17acbd4415b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Action: 'create', calling method: .version_select at 0x7fd79c2ae3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1688072311"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:06.768949 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-eda1cbc6-1df3-4422-89b6-17acbd4415b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Getting quotas for project ae0b248663174800af3db2a34d92f6b3. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:39:06.784940 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-eda1cbc6-1df3-4422-89b6-17acbd4415b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Getting quotas for user 8fa045c5aa324b8a8e3f3d83437c706d and project ae0b248663174800af3db2a34d92f6b3. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:39:07.025548 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f2ce3d0c-b5ad-461d-81e8-402d06018fb0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:07.066272 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f2ce3d0c-b5ad-461d-81e8-402d06018fb0 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.589352 Dec 15 13:39:07.083306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 199/398] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:06 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:07.092234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-05a3f8d1-f45c-48b5-b42f-d434b2e97d91 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:07.094732 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-05a3f8d1-f45c-48b5-b42f-d434b2e97d91 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:07.106659 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05a3f8d1-f45c-48b5-b42f-d434b2e97d91 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:07.108434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05a3f8d1-f45c-48b5-b42f-d434b2e97d91 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:07.113499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05a3f8d1-f45c-48b5-b42f-d434b2e97d91 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:07.114754 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-05a3f8d1-f45c-48b5-b42f-d434b2e97d91 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:07.602937 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-05a3f8d1-f45c-48b5-b42f-d434b2e97d91 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:07.616072 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-05a3f8d1-f45c-48b5-b42f-d434b2e97d91 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.531431 Dec 15 13:39:07.623385 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 200/399] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:07 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:07.629779 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:07.665434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:07.698558 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:07.699245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:07.706810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:07.717524 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:08.295483 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-eda1cbc6-1df3-4422-89b6-17acbd4415b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Getting quotas for project ae0b248663174800af3db2a34d92f6b3. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:39:08.308721 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-eda1cbc6-1df3-4422-89b6-17acbd4415b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Getting quotas for user 8fa045c5aa324b8a8e3f3d83437c706d and project ae0b248663174800af3db2a34d92f6b3. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:39:08.363998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-eda1cbc6-1df3-4422-89b6-17acbd4415b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 2.169553 Dec 15 13:39:08.364904 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 200/400] 10.222.0.83 () {60 vars in 1157 bytes} [Wed Dec 15 13:39:06 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:08.375011 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a2c0f97b-9910-4efc-9753-8cf139dc2b70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:08.375991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a2c0f97b-9910-4efc-9753-8cf139dc2b70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:08.394239 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2c0f97b-9910-4efc-9753-8cf139dc2b70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:08.395207 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2c0f97b-9910-4efc-9753-8cf139dc2b70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:08.396506 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2c0f97b-9910-4efc-9753-8cf139dc2b70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:08.397124 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a2c0f97b-9910-4efc-9753-8cf139dc2b70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.158356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:10.178010 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:10.190178 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:10.192755 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-92704afb-aba8-4178-a5fe-85e178e1301f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 2.567462 Dec 15 13:39:10.193552 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 201/401] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:07 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:10.198805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-fb543be2-f75a-471f-a84d-2ecde658546e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:10.205862 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-fb543be2-f75a-471f-a84d-2ecde658546e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:10.224471 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fb543be2-f75a-471f-a84d-2ecde658546e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.226223 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fb543be2-f75a-471f-a84d-2ecde658546e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.232259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fb543be2-f75a-471f-a84d-2ecde658546e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.233564 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fb543be2-f75a-471f-a84d-2ecde658546e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.485685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a2c0f97b-9910-4efc-9753-8cf139dc2b70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:10.495904 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a2c0f97b-9910-4efc-9753-8cf139dc2b70 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 2.129635 Dec 15 13:39:10.514567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 201/402] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:08 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:10.529089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-1d05b1ba-b222-422c-8883-8117be8a5215 req-8c7770a4-eab3-4d34-bce5-428dda2733e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10807bb-d9d8-478d-975d-8f923406ec3d", "tag": "bbe47101-d895-493f-ae38-13175facd84c"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:10.530905 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:10.530905 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:39:10.552926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-1d05b1ba-b222-422c-8883-8117be8a5215 req-8c7770a4-eab3-4d34-bce5-428dda2733e7 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:10.553645 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-1d05b1ba-b222-422c-8883-8117be8a5215 req-8c7770a4-eab3-4d34-bce5-428dda2733e7 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:10.583213 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-1d05b1ba-b222-422c-8883-8117be8a5215 req-8c7770a4-eab3-4d34-bce5-428dda2733e7 service nova] Creating event network-changed:bbe47101-d895-493f-ae38-13175facd84c for instance b10807bb-d9d8-478d-975d-8f923406ec3d on hv-cinder-81322 Dec 15 13:39:10.598055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-1d05b1ba-b222-422c-8883-8117be8a5215 req-8c7770a4-eab3-4d34-bce5-428dda2733e7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081249 Dec 15 13:39:10.606180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 202/403] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:10.729308 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-fb543be2-f75a-471f-a84d-2ecde658546e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:10.739867 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-fb543be2-f75a-471f-a84d-2ecde658546e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.544952 Dec 15 13:39:10.751816 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 202/404] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:10 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:11.222486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:11.223605 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:11.235204 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:11.236265 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:11.238243 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:11.245555 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:11.527272 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-aa1f338e-9e07-43f4-8f7f-723ed95e0532 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:11.527860 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-aa1f338e-9e07-43f4-8f7f-723ed95e0532 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:11.535893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aa1f338e-9e07-43f4-8f7f-723ed95e0532 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:11.546655 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aa1f338e-9e07-43f4-8f7f-723ed95e0532 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:11.549127 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aa1f338e-9e07-43f4-8f7f-723ed95e0532 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:11.560536 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aa1f338e-9e07-43f4-8f7f-723ed95e0532 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.031281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:12.049707 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:12.051323 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:12.059594 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d8d4732c-c2be-4457-841c-d39e86bf7518 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.849326 Dec 15 13:39:12.060915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 203/405] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:11 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:12.073130 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ae36c821-fc3f-4ae1-ac19-0ece5532a2c3 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:12.074296 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ae36c821-fc3f-4ae1-ac19-0ece5532a2c3 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:12.084727 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ae36c821-fc3f-4ae1-ac19-0ece5532a2c3 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:12.086400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ae36c821-fc3f-4ae1-ac19-0ece5532a2c3 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.088466 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ae36c821-fc3f-4ae1-ac19-0ece5532a2c3 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:12.090164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ae36c821-fc3f-4ae1-ac19-0ece5532a2c3 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.364241 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-aa1f338e-9e07-43f4-8f7f-723ed95e0532 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:12.376791 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-aa1f338e-9e07-43f4-8f7f-723ed95e0532 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.853703 Dec 15 13:39:12.389444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 203/406] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:11 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:12.422152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ae36c821-fc3f-4ae1-ac19-0ece5532a2c3 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:12.431855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ae36c821-fc3f-4ae1-ac19-0ece5532a2c3 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.367639 Dec 15 13:39:12.432855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 204/407] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:12 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:12.834708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-c701ae5e-9690-4e04-8b75-a8af6b99b6f3 req-f44a3fda-0395-48db-9634-586c488f4c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa99337-9b29-41bc-90eb-cf4ffdbc2a44", "tag": "0387f3fb-6863-45ce-b5d6-5a1b21700b4b"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:12.837646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:12.837646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:39:12.857601 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-c701ae5e-9690-4e04-8b75-a8af6b99b6f3 req-f44a3fda-0395-48db-9634-586c488f4c7c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:12.858394 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-c701ae5e-9690-4e04-8b75-a8af6b99b6f3 req-f44a3fda-0395-48db-9634-586c488f4c7c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:12.880085 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-c701ae5e-9690-4e04-8b75-a8af6b99b6f3 req-f44a3fda-0395-48db-9634-586c488f4c7c service nova] Creating event network-changed:0387f3fb-6863-45ce-b5d6-5a1b21700b4b for instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 on hv-cinder-81322 Dec 15 13:39:12.901029 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-c701ae5e-9690-4e04-8b75-a8af6b99b6f3 req-f44a3fda-0395-48db-9634-586c488f4c7c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066267 Dec 15 13:39:12.902536 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 204/408] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:13.079891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:13.080670 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:13.090076 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.093985 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.095112 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.095778 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.369687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:13.380223 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:13.382093 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:13.383586 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-880ea442-5549-4583-909f-ad418411b367 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.307678 Dec 15 13:39:13.395424 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 205/409] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:13 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:13.398258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-128a5a51-8727-401c-928d-c09ba93f04d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:13.399244 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-128a5a51-8727-401c-928d-c09ba93f04d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:13.406705 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-128a5a51-8727-401c-928d-c09ba93f04d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.407446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-128a5a51-8727-401c-928d-c09ba93f04d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.408480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-128a5a51-8727-401c-928d-c09ba93f04d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.409199 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-128a5a51-8727-401c-928d-c09ba93f04d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.449555 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ef2d7d3d-f6dd-4a62-9cdd-ca9574af8d8c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:13.450585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ef2d7d3d-f6dd-4a62-9cdd-ca9574af8d8c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:13.461880 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ef2d7d3d-f6dd-4a62-9cdd-ca9574af8d8c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.463331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ef2d7d3d-f6dd-4a62-9cdd-ca9574af8d8c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.464337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ef2d7d3d-f6dd-4a62-9cdd-ca9574af8d8c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:13.468135 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ef2d7d3d-f6dd-4a62-9cdd-ca9574af8d8c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:13.682067 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-128a5a51-8727-401c-928d-c09ba93f04d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:13.696010 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-128a5a51-8727-401c-928d-c09ba93f04d2 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.303369 Dec 15 13:39:13.696583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 205/410] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:13 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:13.817296 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ef2d7d3d-f6dd-4a62-9cdd-ca9574af8d8c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:13.824564 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ef2d7d3d-f6dd-4a62-9cdd-ca9574af8d8c tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.379372 Dec 15 13:39:13.825137 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 206/411] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:13 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:14.405630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:14.407173 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:14.416636 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:14.417606 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:14.419292 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:14.420170 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:14.716496 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-65557ece-a6f1-4732-9f7a-66ece38b8f52 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:14.717123 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:14.718000 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-65557ece-a6f1-4732-9f7a-66ece38b8f52 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:14.726356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:14.730063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-65557ece-a6f1-4732-9f7a-66ece38b8f52 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:14.730846 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-65557ece-a6f1-4732-9f7a-66ece38b8f52 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:14.731948 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-65557ece-a6f1-4732-9f7a-66ece38b8f52 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:14.732589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-65557ece-a6f1-4732-9f7a-66ece38b8f52 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:14.735983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:14.745496 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ef376171-ba2b-47ff-994b-04eb8ef60ff5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.345483 Dec 15 13:39:14.752467 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 206/412] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:14 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:14.910924 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c8b4509a-bd53-4540-a634-921949122237 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:14.911536 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c8b4509a-bd53-4540-a634-921949122237 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:14.920808 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c8b4509a-bd53-4540-a634-921949122237 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:14.921255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c8b4509a-bd53-4540-a634-921949122237 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:14.922074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c8b4509a-bd53-4540-a634-921949122237 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:14.922510 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c8b4509a-bd53-4540-a634-921949122237 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:14.959219 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-65557ece-a6f1-4732-9f7a-66ece38b8f52 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:14.976113 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-65557ece-a6f1-4732-9f7a-66ece38b8f52 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.266295 Dec 15 13:39:14.977373 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 207/413] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:14 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:15.144027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c8b4509a-bd53-4540-a634-921949122237 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:15.161374 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c8b4509a-bd53-4540-a634-921949122237 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.254028 Dec 15 13:39:15.162350 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 207/414] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:14 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:15.770721 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:15.771491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:15.778886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:15.779318 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:15.780263 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:15.780693 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:15.990144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:15.996322 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-341b5bba-c01d-455a-a09f-4b5a930e2b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:15.997093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-341b5bba-c01d-455a-a09f-4b5a930e2b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:16.000499 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:16.002543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:16.004020 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2736631c-5ea5-4e76-8260-86176ba410f5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.237115 Dec 15 13:39:16.004811 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 208/415] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:15 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:16.008989 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-341b5bba-c01d-455a-a09f-4b5a930e2b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:16.010675 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-341b5bba-c01d-455a-a09f-4b5a930e2b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:16.011854 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-341b5bba-c01d-455a-a09f-4b5a930e2b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:16.012321 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-341b5bba-c01d-455a-a09f-4b5a930e2b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:16.182864 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c5f2edbf-7804-4394-8799-9fbec787b172 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:16.185082 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c5f2edbf-7804-4394-8799-9fbec787b172 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:16.191209 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-341b5bba-c01d-455a-a09f-4b5a930e2b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:16.197055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5f2edbf-7804-4394-8799-9fbec787b172 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:16.198968 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5f2edbf-7804-4394-8799-9fbec787b172 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:16.200423 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-341b5bba-c01d-455a-a09f-4b5a930e2b96 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.209308 Dec 15 13:39:16.201636 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5f2edbf-7804-4394-8799-9fbec787b172 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:16.202690 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5f2edbf-7804-4394-8799-9fbec787b172 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:16.212692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 208/416] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:15 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:16.379335 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c5f2edbf-7804-4394-8799-9fbec787b172 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:16.387764 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c5f2edbf-7804-4394-8799-9fbec787b172 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.211992 Dec 15 13:39:16.397647 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 209/417] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:16 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:17.027422 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:17.034781 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:17.045554 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:17.046063 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:17.046898 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:17.047339 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:17.217694 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-20855537-6c61-466c-8c8a-fa44ea70ab00 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:17.219007 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-20855537-6c61-466c-8c8a-fa44ea70ab00 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:17.226534 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-20855537-6c61-466c-8c8a-fa44ea70ab00 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:17.230146 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-20855537-6c61-466c-8c8a-fa44ea70ab00 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:17.231229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-20855537-6c61-466c-8c8a-fa44ea70ab00 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:17.233075 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-20855537-6c61-466c-8c8a-fa44ea70ab00 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:17.317553 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:17.341822 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:17.343581 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:17.344943 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b7cc70e6-6092-4107-ac51-6e1a894ae4e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.324400 Dec 15 13:39:17.367912 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 209/418] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:17 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:17.407972 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ee36107c-0059-4db9-be65-a4005b6bc84d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:17.412399 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ee36107c-0059-4db9-be65-a4005b6bc84d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:17.442408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee36107c-0059-4db9-be65-a4005b6bc84d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:17.446484 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee36107c-0059-4db9-be65-a4005b6bc84d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:17.447636 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee36107c-0059-4db9-be65-a4005b6bc84d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:17.449706 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee36107c-0059-4db9-be65-a4005b6bc84d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:17.585158 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-20855537-6c61-466c-8c8a-fa44ea70ab00 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:17.599943 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-20855537-6c61-466c-8c8a-fa44ea70ab00 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.385929 Dec 15 13:39:17.603015 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 210/419] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:17 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:17.740050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ee36107c-0059-4db9-be65-a4005b6bc84d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:17.749166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ee36107c-0059-4db9-be65-a4005b6bc84d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.346662 Dec 15 13:39:17.762890 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 210/420] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:17 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:18.364300 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:18.365609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:18.372469 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:18.373243 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:18.374288 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:18.374889 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:18.535523 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:18.544577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:18.546108 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:18.553817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-171848a0-337a-4d1f-934c-b12f93d36a1e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.193539 Dec 15 13:39:18.554899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 211/421] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:18 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:18.622062 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e4584b3d-7260-43a0-8473-99fb5e080fb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:18.623541 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e4584b3d-7260-43a0-8473-99fb5e080fb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:18.630794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e4584b3d-7260-43a0-8473-99fb5e080fb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:18.631599 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e4584b3d-7260-43a0-8473-99fb5e080fb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:18.632630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e4584b3d-7260-43a0-8473-99fb5e080fb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:18.633437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e4584b3d-7260-43a0-8473-99fb5e080fb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:18.769206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0828695f-7d59-489a-949f-1ffa05d46379 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:18.770072 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0828695f-7d59-489a-949f-1ffa05d46379 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:18.808117 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0828695f-7d59-489a-949f-1ffa05d46379 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:18.808559 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0828695f-7d59-489a-949f-1ffa05d46379 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:18.809357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0828695f-7d59-489a-949f-1ffa05d46379 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:18.809807 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0828695f-7d59-489a-949f-1ffa05d46379 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:18.921735 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e4584b3d-7260-43a0-8473-99fb5e080fb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:18.932744 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e4584b3d-7260-43a0-8473-99fb5e080fb5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.314681 Dec 15 13:39:18.940855 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 211/422] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:18 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:19.022036 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0828695f-7d59-489a-949f-1ffa05d46379 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:19.031204 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0828695f-7d59-489a-949f-1ffa05d46379 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.266463 Dec 15 13:39:19.033400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 212/423] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:18 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:19.573529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:19.574428 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:19.585540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:19.588751 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:19.591501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:19.592149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:19.783655 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:19.792692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:19.794199 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:19.795431 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-75766c83-65b9-403e-88d8-565d93a0ab4b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.226596 Dec 15 13:39:19.795975 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 212/424] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:19 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:19.953356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b1f36899-a273-484e-8f43-e2a25e0039cc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:19.955660 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b1f36899-a273-484e-8f43-e2a25e0039cc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:19.965525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b1f36899-a273-484e-8f43-e2a25e0039cc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:19.966079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b1f36899-a273-484e-8f43-e2a25e0039cc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:19.966817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b1f36899-a273-484e-8f43-e2a25e0039cc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:19.967434 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b1f36899-a273-484e-8f43-e2a25e0039cc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.055309 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2bf0dfa5-0ac3-49c2-acda-d78240714a48 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:20.056059 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2bf0dfa5-0ac3-49c2-acda-d78240714a48 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:20.071123 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2bf0dfa5-0ac3-49c2-acda-d78240714a48 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.072691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2bf0dfa5-0ac3-49c2-acda-d78240714a48 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.074585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2bf0dfa5-0ac3-49c2-acda-d78240714a48 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.075331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2bf0dfa5-0ac3-49c2-acda-d78240714a48 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.197608 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b1f36899-a273-484e-8f43-e2a25e0039cc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:20.207030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b1f36899-a273-484e-8f43-e2a25e0039cc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.261001 Dec 15 13:39:20.207687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 213/425] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:19 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:20.276261 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2bf0dfa5-0ac3-49c2-acda-d78240714a48 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:20.283935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2bf0dfa5-0ac3-49c2-acda-d78240714a48 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.234006 Dec 15 13:39:20.284726 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 213/426] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:20 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:20.815567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:20.816532 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:20.823363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.823987 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.824934 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:20.825584 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:20.977637 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:20.987293 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:20.989106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:20.990314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-81cb659f-4692-43a5-af31-4207c11db931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.179552 Dec 15 13:39:20.990856 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 214/427] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:20 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:21.225881 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-dea5fe16-6a82-478a-8012-ffc27eb5c553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:21.227089 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-dea5fe16-6a82-478a-8012-ffc27eb5c553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:21.235211 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dea5fe16-6a82-478a-8012-ffc27eb5c553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:21.235660 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dea5fe16-6a82-478a-8012-ffc27eb5c553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:21.236652 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dea5fe16-6a82-478a-8012-ffc27eb5c553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:21.237098 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dea5fe16-6a82-478a-8012-ffc27eb5c553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:21.306094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-03b69b5d-2346-4f2f-bfb2-53babda5f7a0 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:21.307280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-03b69b5d-2346-4f2f-bfb2-53babda5f7a0 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:21.314644 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03b69b5d-2346-4f2f-bfb2-53babda5f7a0 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:21.315102 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03b69b5d-2346-4f2f-bfb2-53babda5f7a0 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:21.316148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03b69b5d-2346-4f2f-bfb2-53babda5f7a0 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:21.316528 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03b69b5d-2346-4f2f-bfb2-53babda5f7a0 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:21.410365 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-dea5fe16-6a82-478a-8012-ffc27eb5c553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:21.419152 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-dea5fe16-6a82-478a-8012-ffc27eb5c553 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.197936 Dec 15 13:39:21.419983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 214/428] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:21 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:21.489347 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-03b69b5d-2346-4f2f-bfb2-53babda5f7a0 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:21.497539 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-03b69b5d-2346-4f2f-bfb2-53babda5f7a0 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.195155 Dec 15 13:39:21.506613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 215/429] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:21 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:22.010267 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:22.010967 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:22.018186 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.018632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.019418 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.019844 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.171577 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:22.180905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:22.182586 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:22.183751 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1c30ded8-a47b-44ca-b944-fb718b6a17f9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.177509 Dec 15 13:39:22.196180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 215/430] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:22 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:22.446999 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5cccedbc-36db-4c59-a282-bc580eee5436 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:22.448204 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5cccedbc-36db-4c59-a282-bc580eee5436 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:22.457954 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5cccedbc-36db-4c59-a282-bc580eee5436 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.458638 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5cccedbc-36db-4c59-a282-bc580eee5436 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.459548 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5cccedbc-36db-4c59-a282-bc580eee5436 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.459988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5cccedbc-36db-4c59-a282-bc580eee5436 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.517114 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c98a5ae2-afdf-4bb5-baa3-390c9dbbcf3d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:22.517878 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c98a5ae2-afdf-4bb5-baa3-390c9dbbcf3d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:22.524232 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c98a5ae2-afdf-4bb5-baa3-390c9dbbcf3d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.525154 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c98a5ae2-afdf-4bb5-baa3-390c9dbbcf3d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.526725 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c98a5ae2-afdf-4bb5-baa3-390c9dbbcf3d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.527153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c98a5ae2-afdf-4bb5-baa3-390c9dbbcf3d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.675530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5cccedbc-36db-4c59-a282-bc580eee5436 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:22.687029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5cccedbc-36db-4c59-a282-bc580eee5436 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.243065 Dec 15 13:39:22.688970 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 216/431] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:22 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:22.786782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c98a5ae2-afdf-4bb5-baa3-390c9dbbcf3d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:22.796536 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c98a5ae2-afdf-4bb5-baa3-390c9dbbcf3d tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.285652 Dec 15 13:39:22.798264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 216/432] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:22 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:22.815229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-46fba993-a7d6-4141-b80e-743ae837bbcb req-03e2fd39-e999-4f0c-8a7a-bee6b1bcb8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10807bb-d9d8-478d-975d-8f923406ec3d", "name": "network-vif-plugged", "status": "completed", "tag": "bbe47101-d895-493f-ae38-13175facd84c"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:22.817785 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:22.817785 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:39:22.833103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-46fba993-a7d6-4141-b80e-743ae837bbcb req-03e2fd39-e999-4f0c-8a7a-bee6b1bcb8aa service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:22.833540 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-46fba993-a7d6-4141-b80e-743ae837bbcb req-03e2fd39-e999-4f0c-8a7a-bee6b1bcb8aa service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:22.858415 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-46fba993-a7d6-4141-b80e-743ae837bbcb req-03e2fd39-e999-4f0c-8a7a-bee6b1bcb8aa service nova] Creating event network-vif-plugged:bbe47101-d895-493f-ae38-13175facd84c for instance b10807bb-d9d8-478d-975d-8f923406ec3d on hv-cinder-81322 Dec 15 13:39:22.865508 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-46fba993-a7d6-4141-b80e-743ae837bbcb req-03e2fd39-e999-4f0c-8a7a-bee6b1bcb8aa service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063170 Dec 15 13:39:22.866695 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 217/433] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:23.203284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:23.204265 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:23.216415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:23.217425 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:23.217893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:23.220211 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:23.375952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:23.387793 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:23.390753 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:23.392958 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e7ebff44-166b-4a58-8f76-522b2b11f322 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.193701 Dec 15 13:39:23.393919 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 217/434] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:23 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:23.707186 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6452945a-8689-48a9-ba4c-d081d65574fe tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:23.707878 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6452945a-8689-48a9-ba4c-d081d65574fe tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:23.714979 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6452945a-8689-48a9-ba4c-d081d65574fe tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:23.715461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6452945a-8689-48a9-ba4c-d081d65574fe tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:23.716488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6452945a-8689-48a9-ba4c-d081d65574fe tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:23.716924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6452945a-8689-48a9-ba4c-d081d65574fe tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:23.814614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-bd236de8-b5fe-47e9-8b42-f3c44b5b4437 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:23.815345 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-bd236de8-b5fe-47e9-8b42-f3c44b5b4437 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:23.826250 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd236de8-b5fe-47e9-8b42-f3c44b5b4437 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:23.826695 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd236de8-b5fe-47e9-8b42-f3c44b5b4437 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:23.827490 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd236de8-b5fe-47e9-8b42-f3c44b5b4437 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:23.827923 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd236de8-b5fe-47e9-8b42-f3c44b5b4437 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:24.164026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6452945a-8689-48a9-ba4c-d081d65574fe tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:24.180630 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6452945a-8689-48a9-ba4c-d081d65574fe tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.477232 Dec 15 13:39:24.187526 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 218/435] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:23 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:24.220997 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-bd236de8-b5fe-47e9-8b42-f3c44b5b4437 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:24.228815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-bd236de8-b5fe-47e9-8b42-f3c44b5b4437 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1315 microversion: 2.1 time: 0.417794 Dec 15 13:39:24.229391 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 218/436] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:23 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:24.416572 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:24.417509 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:24.424608 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:24.425124 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:24.426080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:24.426772 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:24.579813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:24.589426 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:24.591762 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:24.593281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6bedbb48-ff04-45a0-8fd5-53a4065f41ce tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.184561 Dec 15 13:39:24.594106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 219/437] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:24 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:25.210743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9db127df-7df3-424c-bb62-4e932621634a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:25.211419 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9db127df-7df3-424c-bb62-4e932621634a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:25.218834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9db127df-7df3-424c-bb62-4e932621634a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.219284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9db127df-7df3-424c-bb62-4e932621634a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.220077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9db127df-7df3-424c-bb62-4e932621634a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.220517 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9db127df-7df3-424c-bb62-4e932621634a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.246195 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0de35a42-a890-4b73-adfa-e87e093054fc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:25.246798 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0de35a42-a890-4b73-adfa-e87e093054fc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:25.253079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0de35a42-a890-4b73-adfa-e87e093054fc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.253525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0de35a42-a890-4b73-adfa-e87e093054fc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.254338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0de35a42-a890-4b73-adfa-e87e093054fc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.254769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0de35a42-a890-4b73-adfa-e87e093054fc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.425735 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9db127df-7df3-424c-bb62-4e932621634a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:25.435005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9db127df-7df3-424c-bb62-4e932621634a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.228104 Dec 15 13:39:25.436221 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 219/438] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:25 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:25.444656 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0de35a42-a890-4b73-adfa-e87e093054fc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:25.453067 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0de35a42-a890-4b73-adfa-e87e093054fc tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1464 microversion: 2.1 time: 0.211032 Dec 15 13:39:25.453741 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 220/439] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:25 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1464 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:25.496954 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b2527463-5823-49c5-979a-66e04f779bb8 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:25.497532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b2527463-5823-49c5-979a-66e04f779bb8 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:25.503420 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b2527463-5823-49c5-979a-66e04f779bb8 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.503861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b2527463-5823-49c5-979a-66e04f779bb8 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.504630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b2527463-5823-49c5-979a-66e04f779bb8 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.505065 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b2527463-5823-49c5-979a-66e04f779bb8 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.529783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b2527463-5823-49c5-979a-66e04f779bb8 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:39:25.613303 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:25.614461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:25.623856 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.624655 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.626406 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.627144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.644781 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b2527463-5823-49c5-979a-66e04f779bb8 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 204 len: 0 microversion: 2.1 time: 0.153286 Dec 15 13:39:25.646822 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 220/440] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:39:25 2021] DELETE /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:39:25.658277 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d63a2480-6b48-4c08-847c-3355b24f3018 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:25.658972 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d63a2480-6b48-4c08-847c-3355b24f3018 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:25.665807 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d63a2480-6b48-4c08-847c-3355b24f3018 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.667240 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d63a2480-6b48-4c08-847c-3355b24f3018 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.668367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d63a2480-6b48-4c08-847c-3355b24f3018 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:25.668850 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d63a2480-6b48-4c08-847c-3355b24f3018 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:25.845566 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:25.855131 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:25.856587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:25.857861 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-550df701-57a3-41ee-b138-50eafd2ff8a3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.248531 Dec 15 13:39:25.858006 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d63a2480-6b48-4c08-847c-3355b24f3018 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:25.859038 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 221/441] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:25 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:25.867874 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d63a2480-6b48-4c08-847c-3355b24f3018 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1470 microversion: 2.1 time: 0.216243 Dec 15 13:39:25.868834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 221/442] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:25 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:26.453001 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1237a96a-4f3b-413c-835c-7d626f195614 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:26.453599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1237a96a-4f3b-413c-835c-7d626f195614 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:26.460153 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1237a96a-4f3b-413c-835c-7d626f195614 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.460598 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1237a96a-4f3b-413c-835c-7d626f195614 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.461375 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1237a96a-4f3b-413c-835c-7d626f195614 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.461862 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1237a96a-4f3b-413c-835c-7d626f195614 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.598152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1237a96a-4f3b-413c-835c-7d626f195614 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:26.607280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1237a96a-4f3b-413c-835c-7d626f195614 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.157952 Dec 15 13:39:26.607851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 222/443] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:26 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:26.876652 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:26.877345 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:26.883720 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.884166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.885040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.885478 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.886109 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1090787b-b4d1-4ee0-958a-b4146f177b05 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:26.886724 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1090787b-b4d1-4ee0-958a-b4146f177b05 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:26.892895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1090787b-b4d1-4ee0-958a-b4146f177b05 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.893279 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1090787b-b4d1-4ee0-958a-b4146f177b05 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:26.894100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1090787b-b4d1-4ee0-958a-b4146f177b05 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:26.894536 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1090787b-b4d1-4ee0-958a-b4146f177b05 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:27.084767 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:27.089124 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1090787b-b4d1-4ee0-958a-b4146f177b05 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:27.093512 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:27.095081 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:27.096241 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-19e1a691-1193-45b8-bca1-66fa211a73b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.223307 Dec 15 13:39:27.097149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 222/444] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:26 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:39:27.099773 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1090787b-b4d1-4ee0-958a-b4146f177b05 tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1470 microversion: 2.1 time: 0.217637 Dec 15 13:39:27.100687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 223/445] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:26 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:27.624665 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2e08098f-bcae-4200-ba05-6433af27d922 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:27.625236 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2e08098f-bcae-4200-ba05-6433af27d922 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:27.631119 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2e08098f-bcae-4200-ba05-6433af27d922 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:27.631567 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2e08098f-bcae-4200-ba05-6433af27d922 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:27.632344 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2e08098f-bcae-4200-ba05-6433af27d922 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:27.632797 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2e08098f-bcae-4200-ba05-6433af27d922 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:27.768091 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2e08098f-bcae-4200-ba05-6433af27d922 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:27.776431 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2e08098f-bcae-4200-ba05-6433af27d922 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.155529 Dec 15 13:39:27.776985 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 223/446] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:27 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:28.115445 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:28.116438 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:28.117099 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1eb09067-e01f-42af-8d13-d618a111d99e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:28.118172 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1eb09067-e01f-42af-8d13-d618a111d99e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:28.124176 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.124616 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.125395 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.125602 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1eb09067-e01f-42af-8d13-d618a111d99e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.125862 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.126001 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1eb09067-e01f-42af-8d13-d618a111d99e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.134467 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1eb09067-e01f-42af-8d13-d618a111d99e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.136094 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1eb09067-e01f-42af-8d13-d618a111d99e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.340973 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:28.343421 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1eb09067-e01f-42af-8d13-d618a111d99e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd856659215346d39dedfdb6648f90e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b040f42f67e4061b728e00adb165e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:28.351207 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1eb09067-e01f-42af-8d13-d618a111d99e tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 200 len: 1470 microversion: 2.1 time: 0.237808 Dec 15 13:39:28.352088 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 224/447] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:28 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:28.355524 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:28.357659 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:28.359078 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7099e98b-cdec-4d5a-9077-5e81fd56ec9e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.247324 Dec 15 13:39:28.360117 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 224/448] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:28 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:28.466855 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-b80245f1-9215-4e74-8791-061b6ebacaf7 req-181c16bb-6cc8-4281-8424-501af3526852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10807bb-d9d8-478d-975d-8f923406ec3d", "name": "network-vif-deleted", "tag": "bbe47101-d895-493f-ae38-13175facd84c"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:28.468911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:28.468911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:39:28.479865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-b80245f1-9215-4e74-8791-061b6ebacaf7 req-181c16bb-6cc8-4281-8424-501af3526852 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.480908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-b80245f1-9215-4e74-8791-061b6ebacaf7 req-181c16bb-6cc8-4281-8424-501af3526852 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.493098 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-b80245f1-9215-4e74-8791-061b6ebacaf7 req-181c16bb-6cc8-4281-8424-501af3526852 service nova] Creating event network-vif-deleted:bbe47101-d895-493f-ae38-13175facd84c for instance b10807bb-d9d8-478d-975d-8f923406ec3d on hv-cinder-81322 Dec 15 13:39:28.501063 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-b80245f1-9215-4e74-8791-061b6ebacaf7 req-181c16bb-6cc8-4281-8424-501af3526852 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038784 Dec 15 13:39:28.502020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 225/449] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:28.771291 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-ad1590b7-75dc-43a1-9933-2f4b1fbfcd5b req-c933db8f-66e0-41cc-874b-6b331a68e6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16af4c97-7ce7-47dd-8493-24d19a46221d", "name": "network-vif-plugged", "status": "completed", "tag": "e4b8c97b-020a-4806-8f09-f876ba55ad9d"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:28.773017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:28.773017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:39:28.780480 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-ad1590b7-75dc-43a1-9933-2f4b1fbfcd5b req-c933db8f-66e0-41cc-874b-6b331a68e6eb service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.781028 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-ad1590b7-75dc-43a1-9933-2f4b1fbfcd5b req-c933db8f-66e0-41cc-874b-6b331a68e6eb service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.794988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-ad1590b7-75dc-43a1-9933-2f4b1fbfcd5b req-c933db8f-66e0-41cc-874b-6b331a68e6eb service nova] Creating event network-vif-plugged:e4b8c97b-020a-4806-8f09-f876ba55ad9d for instance 16af4c97-7ce7-47dd-8493-24d19a46221d on hv-cinder-81322 Dec 15 13:39:28.795209 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-14f8f03d-faf0-4e58-acd6-af2c6b21acdc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:28.800657 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-ad1590b7-75dc-43a1-9933-2f4b1fbfcd5b req-c933db8f-66e0-41cc-874b-6b331a68e6eb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033143 Dec 15 13:39:28.801496 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 225/450] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:28.801616 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-14f8f03d-faf0-4e58-acd6-af2c6b21acdc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:28.814302 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-14f8f03d-faf0-4e58-acd6-af2c6b21acdc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.814921 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-14f8f03d-faf0-4e58-acd6-af2c6b21acdc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.816154 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-14f8f03d-faf0-4e58-acd6-af2c6b21acdc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:28.816589 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-14f8f03d-faf0-4e58-acd6-af2c6b21acdc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:28.959574 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-14f8f03d-faf0-4e58-acd6-af2c6b21acdc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:28.970430 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-14f8f03d-faf0-4e58-acd6-af2c6b21acdc tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.180666 Dec 15 13:39:28.971282 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 226/451] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:28 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:29.369821 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:29.370648 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] [instance: b10807bb-d9d8-478d-975d-8f923406ec3d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:29.376998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:29.377538 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:29.378413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:29.379029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:29.379259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:29.379944 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:29.387779 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:29.388297 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:29.389017 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:29.389446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:29.393254 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] HTTP exception thrown: Instance b10807bb-d9d8-478d-975d-8f923406ec3d could not be found. Dec 15 13:39:29.393843 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] Returning 404 to user: Instance b10807bb-d9d8-478d-975d-8f923406ec3d could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:39:29.394682 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b45bd901-0c7b-4e5c-848c-ee22b705ad7f tempest-VolumesNegativeTest-1361222 tempest-VolumesNegativeTest-1361222-project] 10.222.0.83 "GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d" status: 404 len: 111 microversion: 2.1 time: 0.029680 Dec 15 13:39:29.395243 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 226/452] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:29 2021] GET /compute/v2.1/servers/b10807bb-d9d8-478d-975d-8f923406ec3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:39:29.528855 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:29.537180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:29.538708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:29.539868 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-92641c83-8270-4934-99b2-30bee9878ac1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.164344 Dec 15 13:39:29.540437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 227/453] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:29 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:29.989224 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-623e2054-8a29-417f-8a9c-d932c58e8107 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:29.989849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-623e2054-8a29-417f-8a9c-d932c58e8107 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:29.996888 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-623e2054-8a29-417f-8a9c-d932c58e8107 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:29.997326 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-623e2054-8a29-417f-8a9c-d932c58e8107 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:29.998236 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-623e2054-8a29-417f-8a9c-d932c58e8107 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:29.998668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-623e2054-8a29-417f-8a9c-d932c58e8107 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:30.148334 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-623e2054-8a29-417f-8a9c-d932c58e8107 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:30.157996 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-623e2054-8a29-417f-8a9c-d932c58e8107 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.172866 Dec 15 13:39:30.160102 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 227/454] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:29 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:30.559498 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:30.560125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:30.566590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:30.567037 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:30.567817 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:30.568248 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:30.708373 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:30.717883 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:30.719370 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:30.720559 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6def8ebf-7962-4eb8-9ce0-17e4be8e0995 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.164863 Dec 15 13:39:30.721110 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 228/455] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:30 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:39:31.174875 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b34cf7cb-e51e-43ea-9281-9b4d492b68a8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:31.175480 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b34cf7cb-e51e-43ea-9281-9b4d492b68a8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:31.182490 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b34cf7cb-e51e-43ea-9281-9b4d492b68a8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:31.182938 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b34cf7cb-e51e-43ea-9281-9b4d492b68a8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:31.183724 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b34cf7cb-e51e-43ea-9281-9b4d492b68a8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:31.184157 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b34cf7cb-e51e-43ea-9281-9b4d492b68a8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:31.319781 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b34cf7cb-e51e-43ea-9281-9b4d492b68a8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:31.329948 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b34cf7cb-e51e-43ea-9281-9b4d492b68a8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.158431 Dec 15 13:39:31.330579 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 228/456] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:31 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:31.739169 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:31.740411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:31.747672 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:31.748117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:31.748895 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:31.749327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:31.886074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:31.894301 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:31.895785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:31.896914 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c30857e1-0d68-4cb2-97b6-1a97c0f1ef51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.161790 Dec 15 13:39:31.897470 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 229/457] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:31 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:32.349264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8b6982c8-a4fc-4726-b7a1-678569dd3c7c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:32.349896 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8b6982c8-a4fc-4726-b7a1-678569dd3c7c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:32.356167 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8b6982c8-a4fc-4726-b7a1-678569dd3c7c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:32.356617 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8b6982c8-a4fc-4726-b7a1-678569dd3c7c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:32.357383 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8b6982c8-a4fc-4726-b7a1-678569dd3c7c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:32.357913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8b6982c8-a4fc-4726-b7a1-678569dd3c7c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:32.498579 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-8b6982c8-a4fc-4726-b7a1-678569dd3c7c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:32.506287 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8b6982c8-a4fc-4726-b7a1-678569dd3c7c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.160712 Dec 15 13:39:32.506848 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 229/458] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:32 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:32.915881 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:32.917106 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:32.926163 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:32.926602 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:32.927405 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:32.927828 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:33.069727 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:33.078513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:33.080315 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:33.081574 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-aabe9df2-85cc-4b54-9966-b0266ae4f632 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.169590 Dec 15 13:39:33.082182 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 230/459] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:32 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:33.524101 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cc01375f-0e6d-463f-9f20-5e96134845f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:33.524636 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cc01375f-0e6d-463f-9f20-5e96134845f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:33.531531 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cc01375f-0e6d-463f-9f20-5e96134845f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:33.531969 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cc01375f-0e6d-463f-9f20-5e96134845f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:33.532774 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cc01375f-0e6d-463f-9f20-5e96134845f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:33.533225 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cc01375f-0e6d-463f-9f20-5e96134845f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:33.680249 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-cc01375f-0e6d-463f-9f20-5e96134845f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:33.688609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cc01375f-0e6d-463f-9f20-5e96134845f8 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.168584 Dec 15 13:39:33.689212 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 230/460] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:33 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:34.099969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:34.100525 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:34.107314 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:34.107761 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:34.108554 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:34.108984 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:34.249821 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:34.258175 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:34.259666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:34.261619 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7a442aff-a84e-4392-840a-e967633c7e72 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.165473 Dec 15 13:39:34.262606 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 231/461] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:34 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:34.707188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-596d9830-612d-4a72-92d7-aad565c2e659 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:34.708300 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-596d9830-612d-4a72-92d7-aad565c2e659 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:34.715269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-596d9830-612d-4a72-92d7-aad565c2e659 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:34.715713 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-596d9830-612d-4a72-92d7-aad565c2e659 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:34.716502 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-596d9830-612d-4a72-92d7-aad565c2e659 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:34.716938 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-596d9830-612d-4a72-92d7-aad565c2e659 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:34.862882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-596d9830-612d-4a72-92d7-aad565c2e659 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:34.874117 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-596d9830-612d-4a72-92d7-aad565c2e659 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.171532 Dec 15 13:39:34.874694 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 231/462] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:34 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:35.281378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:35.281992 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:35.288201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:35.288636 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:35.289394 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:35.289843 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:35.441198 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:35.450599 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:35.452086 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:35.453237 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d44d080c-f617-4ee8-9626-9b007a0c9a0f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.175586 Dec 15 13:39:35.453812 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 232/463] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:35 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:35.892271 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-477e186d-4683-45d7-b6f1-7e648574cf6a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:35.892852 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-477e186d-4683-45d7-b6f1-7e648574cf6a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:35.899339 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-477e186d-4683-45d7-b6f1-7e648574cf6a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:35.899880 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-477e186d-4683-45d7-b6f1-7e648574cf6a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:35.901556 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-477e186d-4683-45d7-b6f1-7e648574cf6a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:35.902161 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-477e186d-4683-45d7-b6f1-7e648574cf6a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:36.049516 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-477e186d-4683-45d7-b6f1-7e648574cf6a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:36.057913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-477e186d-4683-45d7-b6f1-7e648574cf6a tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.169104 Dec 15 13:39:36.058557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 232/464] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:35 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:36.472322 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:36.472894 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:36.479049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:36.479492 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:36.480264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:36.480688 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:36.616574 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:36.625989 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:36.627480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:36.628633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-30bba848-9b36-43bc-88aa-cd6f0c20ec84 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.160078 Dec 15 13:39:36.629185 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 233/465] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:36 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:37.076090 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e1c0c306-82d6-476d-acb1-cdc8439dd7a7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:37.076610 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e1c0c306-82d6-476d-acb1-cdc8439dd7a7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:37.083125 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e1c0c306-82d6-476d-acb1-cdc8439dd7a7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:37.083575 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e1c0c306-82d6-476d-acb1-cdc8439dd7a7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:37.084347 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e1c0c306-82d6-476d-acb1-cdc8439dd7a7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:37.084787 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e1c0c306-82d6-476d-acb1-cdc8439dd7a7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:37.216564 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e1c0c306-82d6-476d-acb1-cdc8439dd7a7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:37.224209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e1c0c306-82d6-476d-acb1-cdc8439dd7a7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.152453 Dec 15 13:39:37.224770 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 233/466] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:37 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:37.647004 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:37.647770 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:37.654860 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:37.655304 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:37.656112 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:37.656596 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:37.796708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:37.805029 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:37.806543 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:37.807716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-26618252-7201-4577-a621-322dbc787174 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.164452 Dec 15 13:39:37.808263 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 234/467] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:37 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:38.241287 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-70e5b9f4-e76b-43fc-9e93-766ae897c272 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:38.241920 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-70e5b9f4-e76b-43fc-9e93-766ae897c272 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:38.248167 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-70e5b9f4-e76b-43fc-9e93-766ae897c272 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:38.248607 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-70e5b9f4-e76b-43fc-9e93-766ae897c272 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:38.249404 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-70e5b9f4-e76b-43fc-9e93-766ae897c272 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:38.249875 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-70e5b9f4-e76b-43fc-9e93-766ae897c272 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:38.382718 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-70e5b9f4-e76b-43fc-9e93-766ae897c272 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:38.394067 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-70e5b9f4-e76b-43fc-9e93-766ae897c272 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.156256 Dec 15 13:39:38.394707 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 234/468] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:38 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:38.827288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:38.827897 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:38.834608 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:38.835053 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:38.835837 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:38.836267 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:38.973430 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:38.982356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:38.983835 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:38.984983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ee452f7d-8eef-485b-8b91-c3b92998fded tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.161465 Dec 15 13:39:38.985560 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 235/469] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:38 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:39:39.412489 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0b6d58cb-7e1d-4362-954e-fc335b6d1b58 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:39.413256 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0b6d58cb-7e1d-4362-954e-fc335b6d1b58 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:39.420002 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b6d58cb-7e1d-4362-954e-fc335b6d1b58 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:39.421142 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b6d58cb-7e1d-4362-954e-fc335b6d1b58 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:39.422157 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b6d58cb-7e1d-4362-954e-fc335b6d1b58 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:39.423352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b6d58cb-7e1d-4362-954e-fc335b6d1b58 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:39.579137 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0b6d58cb-7e1d-4362-954e-fc335b6d1b58 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:39.588274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0b6d58cb-7e1d-4362-954e-fc335b6d1b58 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.179956 Dec 15 13:39:39.588925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 235/470] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:39 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:39:40.004576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:40.005181 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:40.012634 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:40.013175 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:40.014468 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:40.014985 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:40.179646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:40.188606 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:40.190144 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:40.191322 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4712669a-0697-4e4e-8db3-add50c83c54f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1807 microversion: 2.20 time: 0.190750 Dec 15 13:39:40.191877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 236/471] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:39 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:40.606895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b534bbc6-5316-4a2c-920e-876ec707eb0b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:40.607590 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b534bbc6-5316-4a2c-920e-876ec707eb0b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:40.613688 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b534bbc6-5316-4a2c-920e-876ec707eb0b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:40.614165 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b534bbc6-5316-4a2c-920e-876ec707eb0b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:40.614945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b534bbc6-5316-4a2c-920e-876ec707eb0b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:40.615378 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b534bbc6-5316-4a2c-920e-876ec707eb0b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:40.769179 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b534bbc6-5316-4a2c-920e-876ec707eb0b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:40.777459 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b534bbc6-5316-4a2c-920e-876ec707eb0b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.174095 Dec 15 13:39:40.778196 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 236/472] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:40 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:41.209783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:41.210392 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:41.217041 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:41.217257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:41.218400 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:41.219040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:41.359259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:41.368132 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:41.374040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:41.375234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f3dd95a8-5435-4fc3-a5c2-9715f50151e8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1794 microversion: 2.20 time: 0.169115 Dec 15 13:39:41.375787 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 237/473] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:39:41 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1794 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:39:41.811666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-712ae2c6-00fc-428f-bea6-5c25aaecc17b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:41.814174 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-712ae2c6-00fc-428f-bea6-5c25aaecc17b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:41.824336 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-712ae2c6-00fc-428f-bea6-5c25aaecc17b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:41.824860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-712ae2c6-00fc-428f-bea6-5c25aaecc17b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:41.826849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-712ae2c6-00fc-428f-bea6-5c25aaecc17b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:41.827363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-712ae2c6-00fc-428f-bea6-5c25aaecc17b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:42.098494 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-712ae2c6-00fc-428f-bea6-5c25aaecc17b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:42.107148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-712ae2c6-00fc-428f-bea6-5c25aaecc17b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.316007 Dec 15 13:39:42.107864 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 237/474] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:41 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:43.124612 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-02456768-9148-4858-bf09-20ac30fdb9e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:43.125224 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-02456768-9148-4858-bf09-20ac30fdb9e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:43.131447 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02456768-9148-4858-bf09-20ac30fdb9e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:43.131989 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02456768-9148-4858-bf09-20ac30fdb9e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:43.132892 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02456768-9148-4858-bf09-20ac30fdb9e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:43.134155 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02456768-9148-4858-bf09-20ac30fdb9e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:43.305533 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-02456768-9148-4858-bf09-20ac30fdb9e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:43.316293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-02456768-9148-4858-bf09-20ac30fdb9e7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1567 microversion: 2.1 time: 0.195587 Dec 15 13:39:43.316954 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 238/475] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:43 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:44.334163 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ac8725aa-82ff-4583-b48a-ad493e0f8550 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:44.334769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ac8725aa-82ff-4583-b48a-ad493e0f8550 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:44.341532 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ac8725aa-82ff-4583-b48a-ad493e0f8550 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.342005 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ac8725aa-82ff-4583-b48a-ad493e0f8550 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.342784 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ac8725aa-82ff-4583-b48a-ad493e0f8550 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.343203 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ac8725aa-82ff-4583-b48a-ad493e0f8550 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.513257 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ac8725aa-82ff-4583-b48a-ad493e0f8550 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:44.521658 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ac8725aa-82ff-4583-b48a-ad493e0f8550 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1547 microversion: 2.1 time: 0.191416 Dec 15 13:39:44.522277 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 238/476] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:44 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1547 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:44.540190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:44.540790 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:44.547575 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.548124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.548992 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.549495 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.691326 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] HTTP exception thrown: Cannot 'detach_volume' instance f53bb255-30a9-4c8c-b637-c9f371b04944 while it is in vm_state rescued Dec 15 13:39:44.691958 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Returning 409 to user: Cannot 'detach_volume' instance f53bb255-30a9-4c8c-b637-c9f371b04944 while it is in vm_state rescued {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:39:44.692795 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-fcb1158b-bf95-4ec0-91bd-68a95aa65141 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments/870c8e99-4460-4113-89eb-2894e3aa750c" status: 409 len: 152 microversion: 2.1 time: 0.157441 Dec 15 13:39:44.693346 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 239/477] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:39:44 2021] DELETE /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments/870c8e99-4460-4113-89eb-2894e3aa750c => generated 152 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 13:39:44.702186 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2233a014-c40a-485d-86ec-44f7e44c3586 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:44.702687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2233a014-c40a-485d-86ec-44f7e44c3586 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:44.709135 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2233a014-c40a-485d-86ec-44f7e44c3586 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.709667 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2233a014-c40a-485d-86ec-44f7e44c3586 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.710380 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2233a014-c40a-485d-86ec-44f7e44c3586 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.710814 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2233a014-c40a-485d-86ec-44f7e44c3586 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.781622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2233a014-c40a-485d-86ec-44f7e44c3586 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/action" status: 202 len: 0 microversion: 2.1 time: 0.083649 Dec 15 13:39:44.786912 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 239/478] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:39:44 2021] POST /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:44.795322 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-219df2b2-838d-4855-89c4-3bbe38f1cb65 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:44.797802 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-219df2b2-838d-4855-89c4-3bbe38f1cb65 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:44.808989 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-219df2b2-838d-4855-89c4-3bbe38f1cb65 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.809645 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-219df2b2-838d-4855-89c4-3bbe38f1cb65 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:44.810708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-219df2b2-838d-4855-89c4-3bbe38f1cb65 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:44.811239 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-219df2b2-838d-4855-89c4-3bbe38f1cb65 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:45.004208 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-219df2b2-838d-4855-89c4-3bbe38f1cb65 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:45.012775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-219df2b2-838d-4855-89c4-3bbe38f1cb65 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1555 microversion: 2.1 time: 0.224334 Dec 15 13:39:45.013377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 240/479] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:44 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:46.032015 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9201c4e1-eee8-4a45-a5f1-5908c6cf3cbb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:46.032929 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9201c4e1-eee8-4a45-a5f1-5908c6cf3cbb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:46.039613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9201c4e1-eee8-4a45-a5f1-5908c6cf3cbb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:46.041042 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9201c4e1-eee8-4a45-a5f1-5908c6cf3cbb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:46.041042 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9201c4e1-eee8-4a45-a5f1-5908c6cf3cbb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:46.045589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9201c4e1-eee8-4a45-a5f1-5908c6cf3cbb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:46.242841 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9201c4e1-eee8-4a45-a5f1-5908c6cf3cbb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:46.253027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9201c4e1-eee8-4a45-a5f1-5908c6cf3cbb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1555 microversion: 2.1 time: 0.225591 Dec 15 13:39:46.253708 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 240/480] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:46 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:46.804122 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-327656336", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1688072311", "security_groups": [{"name": "tempest-secgroup-smoke-1524633260"}], "networks": [{"uuid": "fceda14e-72c1-403d-b298-cf6490176d7e"}], "block_device_mapping_v2": [{"uuid": "56bcb253-d684-4611-ae46-64967ac1fe3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:46.957590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] validate_networks() for [('fceda14e-72c1-403d-b298-cf6490176d7e', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:39:47.271745 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-561a36a1-41ee-4b6c-8ef4-036388eab38b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:47.272977 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-561a36a1-41ee-4b6c-8ef4-036388eab38b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:47.281705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-561a36a1-41ee-4b6c-8ef4-036388eab38b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:47.282598 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-561a36a1-41ee-4b6c-8ef4-036388eab38b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:47.283584 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-561a36a1-41ee-4b6c-8ef4-036388eab38b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:47.284182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-561a36a1-41ee-4b6c-8ef4-036388eab38b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:47.539651 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:39:47.540074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:39:47.540742 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:39:47.541354 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:39:47.541980 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:39:47.560345 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:47.561085 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:47.562899 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:47.564909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:47.601398 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-561a36a1-41ee-4b6c-8ef4-036388eab38b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:47.606079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Getting quotas for project ae0b248663174800af3db2a34d92f6b3. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:39:47.611762 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Getting quotas for user 8fa045c5aa324b8a8e3f3d83437c706d and project ae0b248663174800af3db2a34d92f6b3. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:39:47.615805 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-561a36a1-41ee-4b6c-8ef4-036388eab38b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1555 microversion: 2.1 time: 0.348764 Dec 15 13:39:47.626078 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 241/481] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:47 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1555 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:47.690125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:39:47.692455 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56bcb253-d684-4611-ae46-64967ac1fe3a',volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:39:47.865732 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5f04ff6a-484e-4dcb-9a0a-a18ec3645cf8 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.065359 Dec 15 13:39:47.873118 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 241/482] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:39:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:39:47.880223 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fdc3bdf9-0738-4ff5-9742-c51d71cae7b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:47.880840 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fdc3bdf9-0738-4ff5-9742-c51d71cae7b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:47.962265 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fdc3bdf9-0738-4ff5-9742-c51d71cae7b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:47.972530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fdc3bdf9-0738-4ff5-9742-c51d71cae7b0 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1088 microversion: 2.1 time: 0.097830 Dec 15 13:39:47.978624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 242/483] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:47 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1088 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:48.637976 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d801812a-3e15-4da3-9e60-b19f679ced87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:48.638585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d801812a-3e15-4da3-9e60-b19f679ced87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:48.649152 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d801812a-3e15-4da3-9e60-b19f679ced87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:48.649914 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d801812a-3e15-4da3-9e60-b19f679ced87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:48.651731 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d801812a-3e15-4da3-9e60-b19f679ced87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:48.652326 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d801812a-3e15-4da3-9e60-b19f679ced87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:48.868235 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d801812a-3e15-4da3-9e60-b19f679ced87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:48.880835 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d801812a-3e15-4da3-9e60-b19f679ced87 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1561 microversion: 2.1 time: 0.247551 Dec 15 13:39:48.882395 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 242/484] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:48 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:48.990832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-191a0665-9689-45fd-a15d-36b4dc086723 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:48.991631 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-191a0665-9689-45fd-a15d-36b4dc086723 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:49.003744 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-191a0665-9689-45fd-a15d-36b4dc086723 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.004486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-191a0665-9689-45fd-a15d-36b4dc086723 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.005808 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-191a0665-9689-45fd-a15d-36b4dc086723 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.006383 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-191a0665-9689-45fd-a15d-36b4dc086723 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.034019 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-bd5cfc2c-1fe9-4d0f-af4f-896b44214b1b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:49.034654 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-bd5cfc2c-1fe9-4d0f-af4f-896b44214b1b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:49.046743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd5cfc2c-1fe9-4d0f-af4f-896b44214b1b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.047243 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd5cfc2c-1fe9-4d0f-af4f-896b44214b1b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.048048 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd5cfc2c-1fe9-4d0f-af4f-896b44214b1b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.048481 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bd5cfc2c-1fe9-4d0f-af4f-896b44214b1b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.170508 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-191a0665-9689-45fd-a15d-36b4dc086723 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:49.186813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-191a0665-9689-45fd-a15d-36b4dc086723 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1130 microversion: 2.1 time: 0.199244 Dec 15 13:39:49.192365 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 243/485] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:48 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1130 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:49.218667 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-bd5cfc2c-1fe9-4d0f-af4f-896b44214b1b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'services' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:39:49.353126 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-bd5cfc2c-1fe9-4d0f-af4f-896b44214b1b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments/870c8e99-4460-4113-89eb-2894e3aa750c" status: 202 len: 0 microversion: 2.1 time: 0.322762 Dec 15 13:39:49.355241 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 243/486] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:39:49 2021] DELETE /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments/870c8e99-4460-4113-89eb-2894e3aa750c => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:39:49.363475 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-51e38970-389b-4124-b8b7-141b0b811a9b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:49.364634 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-51e38970-389b-4124-b8b7-141b0b811a9b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:49.371042 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-51e38970-389b-4124-b8b7-141b0b811a9b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.371715 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-51e38970-389b-4124-b8b7-141b0b811a9b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.372693 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-51e38970-389b-4124-b8b7-141b0b811a9b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:49.373122 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-51e38970-389b-4124-b8b7-141b0b811a9b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:49.436304 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-51e38970-389b-4124-b8b7-141b0b811a9b tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076403 Dec 15 13:39:49.437357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 244/487] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:39:49 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:39:50.225739 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-07290f60-4d41-48a3-98ba-edd9e30b6afd tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:50.226705 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-07290f60-4d41-48a3-98ba-edd9e30b6afd tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:50.245065 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-07290f60-4d41-48a3-98ba-edd9e30b6afd tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:50.245559 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-07290f60-4d41-48a3-98ba-edd9e30b6afd tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:50.246452 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-07290f60-4d41-48a3-98ba-edd9e30b6afd tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:50.246889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-07290f60-4d41-48a3-98ba-edd9e30b6afd tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:50.347858 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-07290f60-4d41-48a3-98ba-edd9e30b6afd tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:50.355411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-07290f60-4d41-48a3-98ba-edd9e30b6afd tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1204 microversion: 2.1 time: 0.149951 Dec 15 13:39:50.356754 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 244/488] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:50 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1204 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:50.448557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d601028a-b008-4728-b38d-92d8af22f0eb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:50.450100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d601028a-b008-4728-b38d-92d8af22f0eb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:50.468456 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d601028a-b008-4728-b38d-92d8af22f0eb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:50.468701 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d601028a-b008-4728-b38d-92d8af22f0eb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:50.469491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d601028a-b008-4728-b38d-92d8af22f0eb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:50.469946 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d601028a-b008-4728-b38d-92d8af22f0eb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:50.561011 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d601028a-b008-4728-b38d-92d8af22f0eb tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116638 Dec 15 13:39:50.561608 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 245/489] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:39:50 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:51.372444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-431b30c4-e331-4e4e-8b8f-39732fa9eb50 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:51.373094 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-431b30c4-e331-4e4e-8b8f-39732fa9eb50 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:51.379974 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-431b30c4-e331-4e4e-8b8f-39732fa9eb50 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:51.380451 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-431b30c4-e331-4e4e-8b8f-39732fa9eb50 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:51.381236 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-431b30c4-e331-4e4e-8b8f-39732fa9eb50 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:51.381668 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-431b30c4-e331-4e4e-8b8f-39732fa9eb50 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:51.446805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-431b30c4-e331-4e4e-8b8f-39732fa9eb50 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:51.462058 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-431b30c4-e331-4e4e-8b8f-39732fa9eb50 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1192 microversion: 2.1 time: 0.093184 Dec 15 13:39:51.464071 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 245/490] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:51 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:51.572991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-73c069e9-3191-4f6a-80d3-e321336a6df6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:51.575300 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-73c069e9-3191-4f6a-80d3-e321336a6df6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:51.583139 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-73c069e9-3191-4f6a-80d3-e321336a6df6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:51.583594 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-73c069e9-3191-4f6a-80d3-e321336a6df6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:51.584360 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-73c069e9-3191-4f6a-80d3-e321336a6df6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:51.584787 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-73c069e9-3191-4f6a-80d3-e321336a6df6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:51.642867 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-73c069e9-3191-4f6a-80d3-e321336a6df6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074113 Dec 15 13:39:51.648314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 246/491] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:39:51 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:39:52.482615 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c1d8b3f1-65d9-4e54-a785-d069877d951d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:52.483228 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c1d8b3f1-65d9-4e54-a785-d069877d951d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:52.490837 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c1d8b3f1-65d9-4e54-a785-d069877d951d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:52.491316 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c1d8b3f1-65d9-4e54-a785-d069877d951d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:52.492640 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c1d8b3f1-65d9-4e54-a785-d069877d951d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:52.493228 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c1d8b3f1-65d9-4e54-a785-d069877d951d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:52.706695 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c1d8b3f1-65d9-4e54-a785-d069877d951d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:52.714903 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c1d8b3f1-65d9-4e54-a785-d069877d951d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.236991 Dec 15 13:39:52.715524 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 246/492] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:52 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:53.732715 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e3237e33-048e-4078-b84c-f5d253c263f9 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:53.734131 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e3237e33-048e-4078-b84c-f5d253c263f9 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:53.743165 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e3237e33-048e-4078-b84c-f5d253c263f9 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:53.744313 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e3237e33-048e-4078-b84c-f5d253c263f9 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:53.746185 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e3237e33-048e-4078-b84c-f5d253c263f9 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:53.746736 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e3237e33-048e-4078-b84c-f5d253c263f9 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:54.117669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e3237e33-048e-4078-b84c-f5d253c263f9 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:54.127222 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e3237e33-048e-4078-b84c-f5d253c263f9 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.399283 Dec 15 13:39:54.128284 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 247/493] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:53 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:54.731535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-e46e2f50-7536-4e6e-a7dd-aec88102c398 req-2a8b326c-8f9a-466e-8a74-349cff2f5768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cbd3cfd-7384-46fd-8231-1016f1c0cdc6", "tag": "eb15e4a2-9577-4f05-b3d6-86804d162658"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:39:54.736105 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:39:54.736105 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:39:54.749342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-e46e2f50-7536-4e6e-a7dd-aec88102c398 req-2a8b326c-8f9a-466e-8a74-349cff2f5768 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:54.750267 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-e46e2f50-7536-4e6e-a7dd-aec88102c398 req-2a8b326c-8f9a-466e-8a74-349cff2f5768 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:54.765145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-e46e2f50-7536-4e6e-a7dd-aec88102c398 req-2a8b326c-8f9a-466e-8a74-349cff2f5768 service nova] Creating event network-changed:eb15e4a2-9577-4f05-b3d6-86804d162658 for instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 on hv-cinder-81322 Dec 15 13:39:54.771120 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-e46e2f50-7536-4e6e-a7dd-aec88102c398 req-2a8b326c-8f9a-466e-8a74-349cff2f5768 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062685 Dec 15 13:39:54.772116 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 247/494] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:39:55.146008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-81cf01d7-4682-4669-9ae2-2b43c77f3286 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:55.147892 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-81cf01d7-4682-4669-9ae2-2b43c77f3286 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:55.160896 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81cf01d7-4682-4669-9ae2-2b43c77f3286 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:55.165115 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81cf01d7-4682-4669-9ae2-2b43c77f3286 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:55.169334 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81cf01d7-4682-4669-9ae2-2b43c77f3286 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:55.170355 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-81cf01d7-4682-4669-9ae2-2b43c77f3286 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:55.959625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-81cf01d7-4682-4669-9ae2-2b43c77f3286 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:55.971919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-81cf01d7-4682-4669-9ae2-2b43c77f3286 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.831287 Dec 15 13:39:55.972493 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 248/495] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:55 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:56.991681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7b99d662-8148-4e8f-9681-31e91224c2e7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:56.993438 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7b99d662-8148-4e8f-9681-31e91224c2e7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:57.002007 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7b99d662-8148-4e8f-9681-31e91224c2e7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.002690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7b99d662-8148-4e8f-9681-31e91224c2e7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.003741 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7b99d662-8148-4e8f-9681-31e91224c2e7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.004505 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7b99d662-8148-4e8f-9681-31e91224c2e7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.246173 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7b99d662-8148-4e8f-9681-31e91224c2e7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:57.254591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7b99d662-8148-4e8f-9681-31e91224c2e7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.268998 Dec 15 13:39:57.255511 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 248/496] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:56 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:57.334618 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-68b2f13b-b9e2-4c9d-9819-72c889b5e4a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:57.335103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-68b2f13b-b9e2-4c9d-9819-72c889b5e4a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:57.343030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-68b2f13b-b9e2-4c9d-9819-72c889b5e4a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.343744 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-68b2f13b-b9e2-4c9d-9819-72c889b5e4a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.345665 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-68b2f13b-b9e2-4c9d-9819-72c889b5e4a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.346346 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-68b2f13b-b9e2-4c9d-9819-72c889b5e4a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.374669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-68b2f13b-b9e2-4c9d-9819-72c889b5e4a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:39:57.479728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-68b2f13b-b9e2-4c9d-9819-72c889b5e4a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "DELETE /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 204 len: 0 microversion: 2.1 time: 0.148758 Dec 15 13:39:57.483701 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 249/497] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:39:57 2021] DELETE /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:39:57.488604 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-02ddfafd-1bf9-44ac-922e-8417814bc27d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:57.489223 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-02ddfafd-1bf9-44ac-922e-8417814bc27d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:57.495925 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02ddfafd-1bf9-44ac-922e-8417814bc27d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.496374 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02ddfafd-1bf9-44ac-922e-8417814bc27d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.497442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02ddfafd-1bf9-44ac-922e-8417814bc27d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:57.498198 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02ddfafd-1bf9-44ac-922e-8417814bc27d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:57.756011 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-02ddfafd-1bf9-44ac-922e-8417814bc27d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:57.765470 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-02ddfafd-1bf9-44ac-922e-8417814bc27d tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1508 microversion: 2.1 time: 0.280303 Dec 15 13:39:57.777188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 249/498] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:57 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:58.272383 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3bf03a27-c98c-4113-af5b-4b48dfa334ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:58.273094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3bf03a27-c98c-4113-af5b-4b48dfa334ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:58.280177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3bf03a27-c98c-4113-af5b-4b48dfa334ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:58.280721 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3bf03a27-c98c-4113-af5b-4b48dfa334ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:58.282035 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3bf03a27-c98c-4113-af5b-4b48dfa334ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:58.282544 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3bf03a27-c98c-4113-af5b-4b48dfa334ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:58.439425 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3bf03a27-c98c-4113-af5b-4b48dfa334ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:58.447831 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3bf03a27-c98c-4113-af5b-4b48dfa334ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.179909 Dec 15 13:39:58.454871 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 250/499] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:58 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:58.782919 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-dc242b8a-3c90-4576-885b-ccdca7993d09 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:58.784539 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-dc242b8a-3c90-4576-885b-ccdca7993d09 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:58.791463 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dc242b8a-3c90-4576-885b-ccdca7993d09 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:58.792519 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dc242b8a-3c90-4576-885b-ccdca7993d09 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:58.793301 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dc242b8a-3c90-4576-885b-ccdca7993d09 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:58.793727 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dc242b8a-3c90-4576-885b-ccdca7993d09 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:58.972060 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-dc242b8a-3c90-4576-885b-ccdca7993d09 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:58.985315 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-dc242b8a-3c90-4576-885b-ccdca7993d09 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1508 microversion: 2.1 time: 0.205872 Dec 15 13:39:58.996199 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 250/500] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:58 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:39:59.466683 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6770463f-da7e-42aa-8aa4-36ca9da5f6ae tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:39:59.468028 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6770463f-da7e-42aa-8aa4-36ca9da5f6ae tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:39:59.477917 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6770463f-da7e-42aa-8aa4-36ca9da5f6ae tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:59.478851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6770463f-da7e-42aa-8aa4-36ca9da5f6ae tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:59.480543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6770463f-da7e-42aa-8aa4-36ca9da5f6ae tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:39:59.481189 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6770463f-da7e-42aa-8aa4-36ca9da5f6ae tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:39:59.683545 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6770463f-da7e-42aa-8aa4-36ca9da5f6ae tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:39:59.693390 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6770463f-da7e-42aa-8aa4-36ca9da5f6ae tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.232747 Dec 15 13:39:59.699233 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 251/501] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:59 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:00.003299 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6bde3c24-dcee-4d86-8a3f-518bfa79bf06 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:00.005249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6bde3c24-dcee-4d86-8a3f-518bfa79bf06 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:00.017807 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6bde3c24-dcee-4d86-8a3f-518bfa79bf06 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:00.018736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6bde3c24-dcee-4d86-8a3f-518bfa79bf06 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:00.019838 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6bde3c24-dcee-4d86-8a3f-518bfa79bf06 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:00.020481 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6bde3c24-dcee-4d86-8a3f-518bfa79bf06 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:00.229963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6bde3c24-dcee-4d86-8a3f-518bfa79bf06 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:00.238121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6bde3c24-dcee-4d86-8a3f-518bfa79bf06 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1508 microversion: 2.1 time: 0.238804 Dec 15 13:40:00.251306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 251/502] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:39:59 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:00.715621 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4d75c6e3-5c01-4c96-9b91-9fec3c600411 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:00.716238 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4d75c6e3-5c01-4c96-9b91-9fec3c600411 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:00.732136 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4d75c6e3-5c01-4c96-9b91-9fec3c600411 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:00.732574 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4d75c6e3-5c01-4c96-9b91-9fec3c600411 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:00.733551 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4d75c6e3-5c01-4c96-9b91-9fec3c600411 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:00.734169 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4d75c6e3-5c01-4c96-9b91-9fec3c600411 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:00.931346 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4d75c6e3-5c01-4c96-9b91-9fec3c600411 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:00.971901 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4d75c6e3-5c01-4c96-9b91-9fec3c600411 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.260383 Dec 15 13:40:00.974894 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 252/503] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:00 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:01.255289 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d6e51804-d12c-4139-980e-ff1c1c5e4335 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:01.256186 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d6e51804-d12c-4139-980e-ff1c1c5e4335 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:01.266064 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d6e51804-d12c-4139-980e-ff1c1c5e4335 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:01.267162 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d6e51804-d12c-4139-980e-ff1c1c5e4335 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:01.268192 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d6e51804-d12c-4139-980e-ff1c1c5e4335 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:01.268627 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d6e51804-d12c-4139-980e-ff1c1c5e4335 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:01.453506 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d6e51804-d12c-4139-980e-ff1c1c5e4335 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:01.461901 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d6e51804-d12c-4139-980e-ff1c1c5e4335 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1508 microversion: 2.1 time: 0.210007 Dec 15 13:40:01.462494 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 252/504] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:01 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:01.991119 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d277c0a0-f9c7-4be0-8af6-d091e5f17955 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:01.992303 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d277c0a0-f9c7-4be0-8af6-d091e5f17955 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:02.001155 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d277c0a0-f9c7-4be0-8af6-d091e5f17955 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.006400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d277c0a0-f9c7-4be0-8af6-d091e5f17955 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.007571 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d277c0a0-f9c7-4be0-8af6-d091e5f17955 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.008234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d277c0a0-f9c7-4be0-8af6-d091e5f17955 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.222421 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d277c0a0-f9c7-4be0-8af6-d091e5f17955 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:02.236113 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d277c0a0-f9c7-4be0-8af6-d091e5f17955 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.247983 Dec 15 13:40:02.237021 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 253/505] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:01 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:02.483986 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-90124465-2c3d-4ceb-aaf8-cb4ce53e5de9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:02.485533 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-90124465-2c3d-4ceb-aaf8-cb4ce53e5de9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:02.498798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-90124465-2c3d-4ceb-aaf8-cb4ce53e5de9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.499639 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-90124465-2c3d-4ceb-aaf8-cb4ce53e5de9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.500709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-90124465-2c3d-4ceb-aaf8-cb4ce53e5de9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.506124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-90124465-2c3d-4ceb-aaf8-cb4ce53e5de9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.559251 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-cc3593ec-32e0-47ac-92f3-48115fae0eb4 req-50e8cf23-72e1-4732-bb15-de5d4c3c2ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bee9b6-80cd-4147-b4a8-5919d331342e", "name": "network-vif-deleted", "tag": "b2a560ce-9e8c-40f7-9de3-fc3410722da3"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:02.560849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:02.560849 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:02.574787 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-cc3593ec-32e0-47ac-92f3-48115fae0eb4 req-50e8cf23-72e1-4732-bb15-de5d4c3c2ff1 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:02.575183 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-cc3593ec-32e0-47ac-92f3-48115fae0eb4 req-50e8cf23-72e1-4732-bb15-de5d4c3c2ff1 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:02.588250 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-cc3593ec-32e0-47ac-92f3-48115fae0eb4 req-50e8cf23-72e1-4732-bb15-de5d4c3c2ff1 service nova] Creating event network-vif-deleted:b2a560ce-9e8c-40f7-9de3-fc3410722da3 for instance 06bee9b6-80cd-4147-b4a8-5919d331342e on hv-cinder-81322 Dec 15 13:40:02.596487 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-cc3593ec-32e0-47ac-92f3-48115fae0eb4 req-50e8cf23-72e1-4732-bb15-de5d4c3c2ff1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040839 Dec 15 13:40:02.602501 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 254/506] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:02.673041 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-90124465-2c3d-4ceb-aaf8-cb4ce53e5de9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:02.680967 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-90124465-2c3d-4ceb-aaf8-cb4ce53e5de9 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 200 len: 1466 microversion: 2.1 time: 0.205721 Dec 15 13:40:02.685888 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 253/507] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:02 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 1466 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:03.254268 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b74d938e-4df9-49f5-9008-6ae4a3d60586 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:03.255573 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b74d938e-4df9-49f5-9008-6ae4a3d60586 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:03.265477 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b74d938e-4df9-49f5-9008-6ae4a3d60586 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:03.265956 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b74d938e-4df9-49f5-9008-6ae4a3d60586 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:03.266750 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b74d938e-4df9-49f5-9008-6ae4a3d60586 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:03.267181 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b74d938e-4df9-49f5-9008-6ae4a3d60586 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:03.412137 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b74d938e-4df9-49f5-9008-6ae4a3d60586 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:03.419760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b74d938e-4df9-49f5-9008-6ae4a3d60586 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.170618 Dec 15 13:40:03.420589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 255/508] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:03 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:03.698728 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:03.700108 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: 06bee9b6-80cd-4147-b4a8-5919d331342e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:03.706818 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:03.707528 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:03.708503 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:03.709148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:03.724639 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] HTTP exception thrown: Instance 06bee9b6-80cd-4147-b4a8-5919d331342e could not be found. Dec 15 13:40:03.725509 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Returning 404 to user: Instance 06bee9b6-80cd-4147-b4a8-5919d331342e could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:40:03.726834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6ec0a368-e7df-4e9c-8548-dd7420d22f24 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e" status: 404 len: 111 microversion: 2.1 time: 0.032057 Dec 15 13:40:03.727797 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 254/509] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:03 2021] GET /compute/v2.1/servers/06bee9b6-80cd-4147-b4a8-5919d331342e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:40:03.736546 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b4383041-f42a-4432-a429-ee9e07520464 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:03.737192 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b4383041-f42a-4432-a429-ee9e07520464 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:03.748357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b4383041-f42a-4432-a429-ee9e07520464 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:03.748911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b4383041-f42a-4432-a429-ee9e07520464 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:03.749806 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b4383041-f42a-4432-a429-ee9e07520464 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:03.750329 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b4383041-f42a-4432-a429-ee9e07520464 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:03.782929 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b4383041-f42a-4432-a429-ee9e07520464 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:40:03.897441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b4383041-f42a-4432-a429-ee9e07520464 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 204 len: 0 microversion: 2.1 time: 0.164919 Dec 15 13:40:03.898381 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 256/510] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:40:03 2021] DELETE /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:40:03.906426 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-70cc9a1a-d3c2-4e76-970c-3fa85fb56854 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:03.907036 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-70cc9a1a-d3c2-4e76-970c-3fa85fb56854 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:03.913357 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70cc9a1a-d3c2-4e76-970c-3fa85fb56854 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:03.913730 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70cc9a1a-d3c2-4e76-970c-3fa85fb56854 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:03.914532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70cc9a1a-d3c2-4e76-970c-3fa85fb56854 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:03.914956 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70cc9a1a-d3c2-4e76-970c-3fa85fb56854 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:04.077432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-70cc9a1a-d3c2-4e76-970c-3fa85fb56854 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:04.086124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-70cc9a1a-d3c2-4e76-970c-3fa85fb56854 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.183097 Dec 15 13:40:04.086695 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 255/511] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:03 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:04.441976 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-853980e3-f812-49e8-9595-00ddb63387d7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:04.442689 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-853980e3-f812-49e8-9595-00ddb63387d7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:04.452907 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-853980e3-f812-49e8-9595-00ddb63387d7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:04.453615 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-853980e3-f812-49e8-9595-00ddb63387d7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:04.454616 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-853980e3-f812-49e8-9595-00ddb63387d7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:04.455215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-853980e3-f812-49e8-9595-00ddb63387d7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:04.638057 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-853980e3-f812-49e8-9595-00ddb63387d7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:04.645740 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-853980e3-f812-49e8-9595-00ddb63387d7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.209946 Dec 15 13:40:04.646394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 257/512] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:04 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:05.103201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-70eeb704-aee7-4e1e-826c-8eaec22b7511 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:05.103853 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-70eeb704-aee7-4e1e-826c-8eaec22b7511 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:05.111711 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70eeb704-aee7-4e1e-826c-8eaec22b7511 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:05.112323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70eeb704-aee7-4e1e-826c-8eaec22b7511 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:05.113182 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70eeb704-aee7-4e1e-826c-8eaec22b7511 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:05.113722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70eeb704-aee7-4e1e-826c-8eaec22b7511 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:05.269837 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-70eeb704-aee7-4e1e-826c-8eaec22b7511 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:05.278144 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-70eeb704-aee7-4e1e-826c-8eaec22b7511 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.178489 Dec 15 13:40:05.287654 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 256/513] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:05 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:05.664227 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6a739f4e-6345-43d2-b834-d39952cb4a0d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:05.665511 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6a739f4e-6345-43d2-b834-d39952cb4a0d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:05.673303 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a739f4e-6345-43d2-b834-d39952cb4a0d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:05.674019 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a739f4e-6345-43d2-b834-d39952cb4a0d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:05.674801 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a739f4e-6345-43d2-b834-d39952cb4a0d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:05.675447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6a739f4e-6345-43d2-b834-d39952cb4a0d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:05.821144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6a739f4e-6345-43d2-b834-d39952cb4a0d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:05.832772 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6a739f4e-6345-43d2-b834-d39952cb4a0d tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.172147 Dec 15 13:40:05.838026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 258/514] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:05 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:06.295177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a07170b8-c353-42ab-a3e8-21ed1985aeec tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:06.295821 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a07170b8-c353-42ab-a3e8-21ed1985aeec tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:06.302222 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a07170b8-c353-42ab-a3e8-21ed1985aeec tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.302948 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a07170b8-c353-42ab-a3e8-21ed1985aeec tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:06.303735 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a07170b8-c353-42ab-a3e8-21ed1985aeec tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.304347 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a07170b8-c353-42ab-a3e8-21ed1985aeec tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:06.487658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a07170b8-c353-42ab-a3e8-21ed1985aeec tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:06.497605 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a07170b8-c353-42ab-a3e8-21ed1985aeec tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.205809 Dec 15 13:40:06.507886 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 257/515] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:06 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:06.553576 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-597070b1-d08f-434d-b2cc-82ae6d63ebed req-e0f46fd5-fbe2-43d0-9638-309a7a8ce359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbd3cfd-7384-46fd-8231-1016f1c0cdc6", "name": "network-vif-plugged", "status": "completed", "tag": "eb15e4a2-9577-4f05-b3d6-86804d162658"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:06.555394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:06.555394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:06.564236 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-597070b1-d08f-434d-b2cc-82ae6d63ebed req-e0f46fd5-fbe2-43d0-9638-309a7a8ce359 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.566206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-597070b1-d08f-434d-b2cc-82ae6d63ebed req-e0f46fd5-fbe2-43d0-9638-309a7a8ce359 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:06.586746 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-597070b1-d08f-434d-b2cc-82ae6d63ebed req-e0f46fd5-fbe2-43d0-9638-309a7a8ce359 service nova] Creating event network-vif-plugged:eb15e4a2-9577-4f05-b3d6-86804d162658 for instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 on hv-cinder-81322 Dec 15 13:40:06.586746 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-597070b1-d08f-434d-b2cc-82ae6d63ebed req-e0f46fd5-fbe2-43d0-9638-309a7a8ce359 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Dec 15 13:40:06.587039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 259/516] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:06.849084 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1efbfd8d-8d8f-4238-91c9-1f8db7eaa6b2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:06.849682 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1efbfd8d-8d8f-4238-91c9-1f8db7eaa6b2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:06.856491 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1efbfd8d-8d8f-4238-91c9-1f8db7eaa6b2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.856935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1efbfd8d-8d8f-4238-91c9-1f8db7eaa6b2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:06.857725 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1efbfd8d-8d8f-4238-91c9-1f8db7eaa6b2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:06.858174 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1efbfd8d-8d8f-4238-91c9-1f8db7eaa6b2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:07.013899 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1efbfd8d-8d8f-4238-91c9-1f8db7eaa6b2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:07.022038 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1efbfd8d-8d8f-4238-91c9-1f8db7eaa6b2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.176520 Dec 15 13:40:07.022808 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 258/517] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:06 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:07.520184 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4026961e-b2cc-4f5b-b189-37341dc928a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:07.520994 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4026961e-b2cc-4f5b-b189-37341dc928a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:07.532741 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4026961e-b2cc-4f5b-b189-37341dc928a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:07.533730 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4026961e-b2cc-4f5b-b189-37341dc928a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:07.534820 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4026961e-b2cc-4f5b-b189-37341dc928a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:07.535660 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4026961e-b2cc-4f5b-b189-37341dc928a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:07.840979 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4026961e-b2cc-4f5b-b189-37341dc928a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:07.854946 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4026961e-b2cc-4f5b-b189-37341dc928a5 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.342016 Dec 15 13:40:07.865706 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 260/518] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:07 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:08.041149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3d6b28b9-d9d8-4cb8-a5fe-8040af058d5f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:08.042493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3d6b28b9-d9d8-4cb8-a5fe-8040af058d5f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:08.053887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3d6b28b9-d9d8-4cb8-a5fe-8040af058d5f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:08.054983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3d6b28b9-d9d8-4cb8-a5fe-8040af058d5f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:08.055904 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3d6b28b9-d9d8-4cb8-a5fe-8040af058d5f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:08.056581 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3d6b28b9-d9d8-4cb8-a5fe-8040af058d5f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:08.238819 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3d6b28b9-d9d8-4cb8-a5fe-8040af058d5f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:08.248518 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3d6b28b9-d9d8-4cb8-a5fe-8040af058d5f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1260 microversion: 2.1 time: 0.212635 Dec 15 13:40:08.265287 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 259/519] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:08 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:08.411445 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-11702cd2-c798-4af5-9895-8719a82daffd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Action: 'create', calling method: .version_select at 0x7fd79c2a1ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-51881202"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:08.425142 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-11702cd2-c798-4af5-9895-8719a82daffd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Getting quotas for project 56ce01ca50734f87ad8566b49ea5292a. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:08.428964 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-11702cd2-c798-4af5-9895-8719a82daffd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Getting quotas for user 01a989a159d14d8099e2f9b5ee46f1f9 and project 56ce01ca50734f87ad8566b49ea5292a. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:08.501577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-11702cd2-c798-4af5-9895-8719a82daffd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Getting quotas for project 56ce01ca50734f87ad8566b49ea5292a. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:08.505324 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-11702cd2-c798-4af5-9895-8719a82daffd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Getting quotas for user 01a989a159d14d8099e2f9b5ee46f1f9 and project 56ce01ca50734f87ad8566b49ea5292a. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:08.518684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-11702cd2-c798-4af5-9895-8719a82daffd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.111013 Dec 15 13:40:08.519324 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 261/520] 10.222.0.83 () {60 vars in 1157 bytes} [Wed Dec 15 13:40:08 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:08.621517 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-209125405", "imageRef": "4f8908cf-c767-46d1-8e31-2c66d3b2048a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-51881202", "networks": [{"uuid": "67834753-f02a-48bf-8dbe-b2e35c44f89a"}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:08.672347 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] validate_networks() for [('67834753-f02a-48bf-8dbe-b2e35c44f89a', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:40:08.872258 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a9fe7938-585d-488f-b7e7-e32b61ff40be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:08.873099 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a9fe7938-585d-488f-b7e7-e32b61ff40be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:08.879195 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a9fe7938-585d-488f-b7e7-e32b61ff40be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:08.879645 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a9fe7938-585d-488f-b7e7-e32b61ff40be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:08.880640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a9fe7938-585d-488f-b7e7-e32b61ff40be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:08.881076 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a9fe7938-585d-488f-b7e7-e32b61ff40be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.092136 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a9fe7938-585d-488f-b7e7-e32b61ff40be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:09.099642 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a9fe7938-585d-488f-b7e7-e32b61ff40be tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.231420 Dec 15 13:40:09.101533 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 262/521] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:08 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:09.113793 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:40:09.114530 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:40:09.115190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:40:09.115951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:40:09.116420 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:40:09.127739 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.128177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.128978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.129405 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.145775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Getting quotas for project 56ce01ca50734f87ad8566b49ea5292a. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:09.149542 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Getting quotas for user 01a989a159d14d8099e2f9b5ee46f1f9 and project 56ce01ca50734f87ad8566b49ea5292a. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:09.161014 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:40:09.163355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4f8908cf-c767-46d1-8e31-2c66d3b2048a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:40:09.209412 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7ecac133-40c0-4acd-a9b8-8a90be5d99ea tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591505 Dec 15 13:40:09.210216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 260/522] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:40:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:40:09.221550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7aa0a289-5eee-4ca5-ae6b-79b0210443c2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:09.222455 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7aa0a289-5eee-4ca5-ae6b-79b0210443c2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:09.269056 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7309b6af-dd4c-4ff9-869d-07c466f999ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:09.270402 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7309b6af-dd4c-4ff9-869d-07c466f999ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:09.280539 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7309b6af-dd4c-4ff9-869d-07c466f999ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.281568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7309b6af-dd4c-4ff9-869d-07c466f999ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.283125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7309b6af-dd4c-4ff9-869d-07c466f999ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.284091 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7309b6af-dd4c-4ff9-869d-07c466f999ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.290579 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7aa0a289-5eee-4ca5-ae6b-79b0210443c2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:09.298343 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7aa0a289-5eee-4ca5-ae6b-79b0210443c2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1256 microversion: 2.1 time: 0.081014 Dec 15 13:40:09.299478 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 263/523] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:09 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1256 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:09.459249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7309b6af-dd4c-4ff9-869d-07c466f999ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:09.467288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7309b6af-dd4c-4ff9-869d-07c466f999ab tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1444 microversion: 2.1 time: 0.204585 Dec 15 13:40:09.468039 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 261/524] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:09 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1444 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:09.485131 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c0184ff2-505e-4614-8309-77f06e442c53 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:09.485786 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c0184ff2-505e-4614-8309-77f06e442c53 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:09.491975 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c0184ff2-505e-4614-8309-77f06e442c53 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.492421 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c0184ff2-505e-4614-8309-77f06e442c53 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.493181 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c0184ff2-505e-4614-8309-77f06e442c53 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:09.493606 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c0184ff2-505e-4614-8309-77f06e442c53 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:09.638272 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c0184ff2-505e-4614-8309-77f06e442c53 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:09.645793 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c0184ff2-505e-4614-8309-77f06e442c53 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1444 microversion: 2.1 time: 0.164226 Dec 15 13:40:09.646353 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 264/525] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:09 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:10.116126 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-12e6c8d2-9c45-4d29-b0b8-92c57936efef tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:10.116716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-12e6c8d2-9c45-4d29-b0b8-92c57936efef tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:10.123333 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12e6c8d2-9c45-4d29-b0b8-92c57936efef tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:10.123777 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12e6c8d2-9c45-4d29-b0b8-92c57936efef tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:10.124553 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12e6c8d2-9c45-4d29-b0b8-92c57936efef tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:10.124985 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12e6c8d2-9c45-4d29-b0b8-92c57936efef tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:10.313051 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-12e6c8d2-9c45-4d29-b0b8-92c57936efef tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:10.323485 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-12e6c8d2-9c45-4d29-b0b8-92c57936efef tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1521 microversion: 2.1 time: 0.210819 Dec 15 13:40:10.323841 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cc2e7287-e5f3-4520-bdf6-e696c08296f4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:10.334970 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cc2e7287-e5f3-4520-bdf6-e696c08296f4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:10.336655 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 262/526] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:10 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:10.337702 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cc2e7287-e5f3-4520-bdf6-e696c08296f4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:10.339708 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cc2e7287-e5f3-4520-bdf6-e696c08296f4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:10.340594 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cc2e7287-e5f3-4520-bdf6-e696c08296f4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:10.341048 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cc2e7287-e5f3-4520-bdf6-e696c08296f4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:10.423921 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-cc2e7287-e5f3-4520-bdf6-e696c08296f4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:10.432168 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cc2e7287-e5f3-4520-bdf6-e696c08296f4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1326 microversion: 2.1 time: 0.113613 Dec 15 13:40:10.433165 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 265/527] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:10 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:11.039643 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-66dacf35-8bb2-4031-9fad-7a977f7a5e53 req-5079caae-8fb1-4fdb-8bed-9a2dc41e5f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53bb255-30a9-4c8c-b637-c9f371b04944", "name": "network-vif-deleted", "tag": "ba9131b0-fdf7-4ed2-a8c9-1c6801656498"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:11.042378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:11.042378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:40:11.051719 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-66dacf35-8bb2-4031-9fad-7a977f7a5e53 req-5079caae-8fb1-4fdb-8bed-9a2dc41e5f0c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.052376 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-66dacf35-8bb2-4031-9fad-7a977f7a5e53 req-5079caae-8fb1-4fdb-8bed-9a2dc41e5f0c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.068628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-66dacf35-8bb2-4031-9fad-7a977f7a5e53 req-5079caae-8fb1-4fdb-8bed-9a2dc41e5f0c service nova] Creating event network-vif-deleted:ba9131b0-fdf7-4ed2-a8c9-1c6801656498 for instance f53bb255-30a9-4c8c-b637-c9f371b04944 on hv-cinder-81322 Dec 15 13:40:11.076933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-66dacf35-8bb2-4031-9fad-7a977f7a5e53 req-5079caae-8fb1-4fdb-8bed-9a2dc41e5f0c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040786 Dec 15 13:40:11.078064 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 263/528] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:11.342768 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:11.343367 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:11.350668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.351119 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.351909 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.352336 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.387423 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.388297 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.388772 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:11.450952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f6007bb5-0178-495f-9304-d82cb4fd140f tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:11.452555 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f6007bb5-0178-495f-9304-d82cb4fd140f tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:11.461199 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:11.462535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f6007bb5-0178-495f-9304-d82cb4fd140f tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.463624 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f6007bb5-0178-495f-9304-d82cb4fd140f tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.464802 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f6007bb5-0178-495f-9304-d82cb4fd140f tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:11.465472 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f6007bb5-0178-495f-9304-d82cb4fd140f tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:11.470687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-615db993-f73c-4b94-afe9-25f21f2a8167 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.131785 Dec 15 13:40:11.471874 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 266/529] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:11 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:11.609571 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f6007bb5-0178-495f-9304-d82cb4fd140f tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:11.616734 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f6007bb5-0178-495f-9304-d82cb4fd140f tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.170428 Dec 15 13:40:11.617412 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 264/530] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:11 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:12.488125 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:12.488739 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:12.495052 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.495499 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.496284 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.496719 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.540853 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.541301 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.543222 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:12.580508 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:12.589415 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-08a2e20f-1b90-4dad-ad6a-443065341e37 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.104177 Dec 15 13:40:12.590197 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 267/531] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:12 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:12.638976 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a7d888c8-b929-4ab1-959f-c1798866560c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:12.639682 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a7d888c8-b929-4ab1-959f-c1798866560c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:12.646335 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7d888c8-b929-4ab1-959f-c1798866560c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.646875 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7d888c8-b929-4ab1-959f-c1798866560c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.647874 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7d888c8-b929-4ab1-959f-c1798866560c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:12.648372 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7d888c8-b929-4ab1-959f-c1798866560c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:12.817258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a7d888c8-b929-4ab1-959f-c1798866560c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:12.827557 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a7d888c8-b929-4ab1-959f-c1798866560c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.192366 Dec 15 13:40:12.829581 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 265/532] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:12 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:13.097133 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-3a11f140-3903-4ade-9ecd-df5b0aef8ae8 req-abb02b27-2bf5-4695-b6b4-24ccd4b967af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cbd3cfd-7384-46fd-8231-1016f1c0cdc6", "tag": "eb15e4a2-9577-4f05-b3d6-86804d162658"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:13.099646 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:13.099646 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:13.123806 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-3a11f140-3903-4ade-9ecd-df5b0aef8ae8 req-abb02b27-2bf5-4695-b6b4-24ccd4b967af service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.138558 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-3a11f140-3903-4ade-9ecd-df5b0aef8ae8 req-abb02b27-2bf5-4695-b6b4-24ccd4b967af service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:13.150382 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-3a11f140-3903-4ade-9ecd-df5b0aef8ae8 req-abb02b27-2bf5-4695-b6b4-24ccd4b967af service nova] Creating event network-changed:eb15e4a2-9577-4f05-b3d6-86804d162658 for instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 on hv-cinder-81322 Dec 15 13:40:13.165993 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-3a11f140-3903-4ade-9ecd-df5b0aef8ae8 req-abb02b27-2bf5-4695-b6b4-24ccd4b967af service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073658 Dec 15 13:40:13.171035 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 268/533] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:13.606566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:13.607166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:13.613859 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.614312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:13.615175 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.615590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:13.647257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.647869 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:13.648043 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:13.686868 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:13.694345 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9add0b77-3a91-4d99-9b13-2c460352cdaa tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.091480 Dec 15 13:40:13.694918 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 266/534] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:13 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:13.847224 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a86e7e46-5f04-426f-b139-7a083fe26112 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:13.847926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a86e7e46-5f04-426f-b139-7a083fe26112 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:13.854388 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a86e7e46-5f04-426f-b139-7a083fe26112 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.854838 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a86e7e46-5f04-426f-b139-7a083fe26112 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:13.855625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a86e7e46-5f04-426f-b139-7a083fe26112 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:13.856059 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a86e7e46-5f04-426f-b139-7a083fe26112 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:14.012077 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a86e7e46-5f04-426f-b139-7a083fe26112 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:14.021274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a86e7e46-5f04-426f-b139-7a083fe26112 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.178605 Dec 15 13:40:14.021857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 269/535] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:13 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:14.711616 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:14.712198 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:14.718593 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:14.719335 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:14.720191 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:14.720725 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:14.751304 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:14.751753 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:14.752202 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:14.790061 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:14.797158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-831d047e-6bb7-4724-8329-310394e727f3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.089193 Dec 15 13:40:14.797714 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 267/536] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:14 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:15.041663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-44922312-8f76-4780-ba55-a55e1432808e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:15.044696 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-44922312-8f76-4780-ba55-a55e1432808e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:15.050845 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-44922312-8f76-4780-ba55-a55e1432808e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.051297 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-44922312-8f76-4780-ba55-a55e1432808e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.052079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-44922312-8f76-4780-ba55-a55e1432808e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.052684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-44922312-8f76-4780-ba55-a55e1432808e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.209151 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-44922312-8f76-4780-ba55-a55e1432808e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:15.216751 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-44922312-8f76-4780-ba55-a55e1432808e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.181720 Dec 15 13:40:15.217385 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 270/537] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:15 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:15.812805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:15.813405 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:15.820159 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.820659 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.821463 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.821981 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.857033 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:15.857477 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:15.857958 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:15.898571 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:15.907341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f313f9d2-6980-4905-8a9e-8883de61d7b6 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.098096 Dec 15 13:40:15.908751 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 268/538] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:15 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:16.233280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-093b9365-fcc2-4fff-9039-1b2178fe59c1 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:16.233985 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-093b9365-fcc2-4fff-9039-1b2178fe59c1 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:16.240305 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-093b9365-fcc2-4fff-9039-1b2178fe59c1 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:16.240793 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-093b9365-fcc2-4fff-9039-1b2178fe59c1 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:16.241678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-093b9365-fcc2-4fff-9039-1b2178fe59c1 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:16.242441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-093b9365-fcc2-4fff-9039-1b2178fe59c1 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:16.396939 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-093b9365-fcc2-4fff-9039-1b2178fe59c1 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:16.404949 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-093b9365-fcc2-4fff-9039-1b2178fe59c1 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.175444 Dec 15 13:40:16.405516 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 271/539] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:16 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:16.923966 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:16.924549 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:16.930355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:16.930798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:16.931553 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:16.931978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:16.962532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:16.962969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:16.963402 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:17.006503 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:17.018398 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-197521d1-2ba3-468e-9b44-7a39c70c3dba tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.098130 Dec 15 13:40:17.019241 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 269/540] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:16 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:17.422436 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1843abb9-2408-4ee2-9a3a-c6005e1f7a18 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:17.423127 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1843abb9-2408-4ee2-9a3a-c6005e1f7a18 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:17.429353 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1843abb9-2408-4ee2-9a3a-c6005e1f7a18 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.429839 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1843abb9-2408-4ee2-9a3a-c6005e1f7a18 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.430740 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1843abb9-2408-4ee2-9a3a-c6005e1f7a18 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:17.431182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1843abb9-2408-4ee2-9a3a-c6005e1f7a18 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:17.603370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1843abb9-2408-4ee2-9a3a-c6005e1f7a18 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:17.610990 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1843abb9-2408-4ee2-9a3a-c6005e1f7a18 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.192521 Dec 15 13:40:17.611548 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 272/541] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:17 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:18.035909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:18.036468 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:18.042725 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.043510 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.044515 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.045159 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.085516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.086204 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.086650 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:18.130957 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:18.144489 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9a0beb94-55e5-441f-b271-7379bc23757c tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.111776 Dec 15 13:40:18.145506 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 270/542] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:18 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:18.628019 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-05cfe80e-bf55-44bc-9de9-8f996bd23adf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:18.628661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-05cfe80e-bf55-44bc-9de9-8f996bd23adf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:18.635576 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05cfe80e-bf55-44bc-9de9-8f996bd23adf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.636101 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05cfe80e-bf55-44bc-9de9-8f996bd23adf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.636974 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05cfe80e-bf55-44bc-9de9-8f996bd23adf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:18.637448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05cfe80e-bf55-44bc-9de9-8f996bd23adf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:18.789652 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-05cfe80e-bf55-44bc-9de9-8f996bd23adf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:18.801886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-05cfe80e-bf55-44bc-9de9-8f996bd23adf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.177764 Dec 15 13:40:18.802461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 273/543] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:18 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:19.162792 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:19.163380 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:19.170331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.170780 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.171555 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.171988 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.201885 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.202332 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.202777 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:19.241944 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:19.249182 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1ebac090-2ca1-4adf-8fa0-7c44d0aca365 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.090032 Dec 15 13:40:19.249847 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 271/544] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:19 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:19.431535 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2e29486b-85e9-4c2c-9ca8-16e72b751b8d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:19.431926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2e29486b-85e9-4c2c-9ca8-16e72b751b8d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:19.437911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2e29486b-85e9-4c2c-9ca8-16e72b751b8d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.438359 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2e29486b-85e9-4c2c-9ca8-16e72b751b8d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.439136 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2e29486b-85e9-4c2c-9ca8-16e72b751b8d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.439566 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2e29486b-85e9-4c2c-9ca8-16e72b751b8d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.472033 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2e29486b-85e9-4c2c-9ca8-16e72b751b8d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments/4e7a4679-ace3-4ad0-af21-00afa0844071" status: 200 len: 194 microversion: 2.20 time: 0.044314 Dec 15 13:40:19.472629 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 274/545] 10.222.0.83 () {60 vars in 1453 bytes} [Wed Dec 15 13:40:19 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments/4e7a4679-ace3-4ad0-af21-00afa0844071 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:19.538829 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-94b50101-5427-4754-b7e6-d07c63d605ec tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:19.539941 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-94b50101-5427-4754-b7e6-d07c63d605ec tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:19.547015 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-94b50101-5427-4754-b7e6-d07c63d605ec tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.548340 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-94b50101-5427-4754-b7e6-d07c63d605ec tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.549861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-94b50101-5427-4754-b7e6-d07c63d605ec tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.550639 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-94b50101-5427-4754-b7e6-d07c63d605ec tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.638146 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-94b50101-5427-4754-b7e6-d07c63d605ec tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lazy-loading 'services' on Instance uuid 16af4c97-7ce7-47dd-8493-24d19a46221d {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:19.717362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-94b50101-5427-4754-b7e6-d07c63d605ec tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "DELETE /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments/4e7a4679-ace3-4ad0-af21-00afa0844071" status: 202 len: 0 microversion: 2.20 time: 0.182176 Dec 15 13:40:19.717362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 272/546] 10.222.0.83 () {60 vars in 1456 bytes} [Wed Dec 15 13:40:19 2021] DELETE /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments/4e7a4679-ace3-4ad0-af21-00afa0844071 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:40:19.727397 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4134c250-459c-4d8a-a2af-4524c6ac140a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:19.728539 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4134c250-459c-4d8a-a2af-4524c6ac140a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:19.734924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4134c250-459c-4d8a-a2af-4524c6ac140a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.735393 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4134c250-459c-4d8a-a2af-4524c6ac140a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.736335 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4134c250-459c-4d8a-a2af-4524c6ac140a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.736944 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4134c250-459c-4d8a-a2af-4524c6ac140a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.769430 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4134c250-459c-4d8a-a2af-4524c6ac140a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046805 Dec 15 13:40:19.770023 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 275/547] 10.222.0.83 () {60 vars in 1342 bytes} [Wed Dec 15 13:40:19 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:19.824840 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1da18c13-bb72-4d36-9438-293ec93f0fd2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:19.826388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1da18c13-bb72-4d36-9438-293ec93f0fd2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:19.836775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1da18c13-bb72-4d36-9438-293ec93f0fd2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.837550 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1da18c13-bb72-4d36-9438-293ec93f0fd2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.838992 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1da18c13-bb72-4d36-9438-293ec93f0fd2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:19.839737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1da18c13-bb72-4d36-9438-293ec93f0fd2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:19.977231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1da18c13-bb72-4d36-9438-293ec93f0fd2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:19.987395 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1da18c13-bb72-4d36-9438-293ec93f0fd2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.171229 Dec 15 13:40:20.000164 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 273/548] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:19 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:20.265921 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:20.266446 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:20.272231 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.272674 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.273441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.273895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.304280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.304730 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.305182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:20.351765 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:20.361209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9b3d9506-aa66-4f58-b6c5-f9859f16d5a3 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.098988 Dec 15 13:40:20.362029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 276/549] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:20 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:20.781550 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4f4e47d0-4ddb-4879-ba27-59011006f16a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:20.782612 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4f4e47d0-4ddb-4879-ba27-59011006f16a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:20.789037 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4f4e47d0-4ddb-4879-ba27-59011006f16a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.789481 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4f4e47d0-4ddb-4879-ba27-59011006f16a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.790273 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4f4e47d0-4ddb-4879-ba27-59011006f16a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:20.790701 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4f4e47d0-4ddb-4879-ba27-59011006f16a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:20.819309 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4f4e47d0-4ddb-4879-ba27-59011006f16a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041495 Dec 15 13:40:20.819850 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 274/550] 10.222.0.83 () {60 vars in 1342 bytes} [Wed Dec 15 13:40:20 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:21.004680 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-19c8213d-df82-4d9f-b94f-733a5556d3f5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:21.005240 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-19c8213d-df82-4d9f-b94f-733a5556d3f5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:21.011875 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19c8213d-df82-4d9f-b94f-733a5556d3f5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.012312 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19c8213d-df82-4d9f-b94f-733a5556d3f5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.013073 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19c8213d-df82-4d9f-b94f-733a5556d3f5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.013501 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19c8213d-df82-4d9f-b94f-733a5556d3f5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.140452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-19c8213d-df82-4d9f-b94f-733a5556d3f5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:21.148073 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-19c8213d-df82-4d9f-b94f-733a5556d3f5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.147086 Dec 15 13:40:21.148679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 277/551] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:20 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:21.378476 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:21.379075 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:21.384826 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.385273 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.386652 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.386652 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.415766 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.416206 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.416645 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:21.455331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:21.462691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a224bf8a-39bb-4e47-b2e8-1c17d9c01029 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.087870 Dec 15 13:40:21.463248 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 275/552] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:21 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:21.831430 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a641ac9f-f8eb-4df6-8b56-ef1fae111b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:21.832821 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a641ac9f-f8eb-4df6-8b56-ef1fae111b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:21.839560 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a641ac9f-f8eb-4df6-8b56-ef1fae111b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.840292 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a641ac9f-f8eb-4df6-8b56-ef1fae111b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.841237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a641ac9f-f8eb-4df6-8b56-ef1fae111b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:21.841815 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a641ac9f-f8eb-4df6-8b56-ef1fae111b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:21.886392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a641ac9f-f8eb-4df6-8b56-ef1fae111b9a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058923 Dec 15 13:40:21.887331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 278/553] 10.222.0.83 () {60 vars in 1342 bytes} [Wed Dec 15 13:40:21 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:22.166659 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-85345b67-340e-4581-8e68-19173a988f73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:22.167393 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-85345b67-340e-4581-8e68-19173a988f73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:22.173615 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85345b67-340e-4581-8e68-19173a988f73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.174099 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85345b67-340e-4581-8e68-19173a988f73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.174876 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85345b67-340e-4581-8e68-19173a988f73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.175312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85345b67-340e-4581-8e68-19173a988f73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.328039 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-85345b67-340e-4581-8e68-19173a988f73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:22.336504 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-85345b67-340e-4581-8e68-19173a988f73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.173493 Dec 15 13:40:22.337068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 276/554] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:22 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:22.479256 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:22.480285 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:22.486462 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.486928 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.487684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.488115 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.517535 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.518021 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.518458 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:22.556798 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:22.564776 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-587c9a17-91c8-4852-8b24-c7685876d911 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.089254 Dec 15 13:40:22.565319 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 279/555] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:22 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:22.898258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b4cb04af-8453-4ad0-acce-33f22cf9627c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:22.899203 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b4cb04af-8453-4ad0-acce-33f22cf9627c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:22.905498 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4cb04af-8453-4ad0-acce-33f22cf9627c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.905975 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4cb04af-8453-4ad0-acce-33f22cf9627c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.906742 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4cb04af-8453-4ad0-acce-33f22cf9627c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:22.907171 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4cb04af-8453-4ad0-acce-33f22cf9627c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:22.938722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b4cb04af-8453-4ad0-acce-33f22cf9627c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043542 Dec 15 13:40:22.938722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 277/556] 10.222.0.83 () {60 vars in 1342 bytes} [Wed Dec 15 13:40:22 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:23.353739 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4234194c-4974-4aab-96e4-f90d82977432 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:23.354371 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4234194c-4974-4aab-96e4-f90d82977432 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:23.360198 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4234194c-4974-4aab-96e4-f90d82977432 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.360635 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4234194c-4974-4aab-96e4-f90d82977432 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.361392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4234194c-4974-4aab-96e4-f90d82977432 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.361855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4234194c-4974-4aab-96e4-f90d82977432 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.498642 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4234194c-4974-4aab-96e4-f90d82977432 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:23.506492 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4234194c-4974-4aab-96e4-f90d82977432 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.156529 Dec 15 13:40:23.507061 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 280/557] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:23 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:23.580847 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:23.581449 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:23.587919 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.588362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.589166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.589593 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.619116 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.619485 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.619930 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:23.664673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:23.673270 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9e32b52a-94e2-4575-93f5-7f7c7a6c60a1 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.096035 Dec 15 13:40:23.673866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 278/558] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:23 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:23.949947 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-daeafbb2-6e81-403f-9bfe-86fa25210d26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:23.950764 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-daeafbb2-6e81-403f-9bfe-86fa25210d26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:23.957831 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-daeafbb2-6e81-403f-9bfe-86fa25210d26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.958282 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-daeafbb2-6e81-403f-9bfe-86fa25210d26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.959096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-daeafbb2-6e81-403f-9bfe-86fa25210d26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:23.959512 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-daeafbb2-6e81-403f-9bfe-86fa25210d26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:23.988280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-daeafbb2-6e81-403f-9bfe-86fa25210d26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042189 Dec 15 13:40:23.988828 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 281/559] 10.222.0.83 () {60 vars in 1342 bytes} [Wed Dec 15 13:40:23 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:24.524626 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-42d80912-89ee-45af-bff0-e5930fe89002 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:24.525894 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-42d80912-89ee-45af-bff0-e5930fe89002 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:24.532552 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42d80912-89ee-45af-bff0-e5930fe89002 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.533290 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42d80912-89ee-45af-bff0-e5930fe89002 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.534188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42d80912-89ee-45af-bff0-e5930fe89002 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.534687 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42d80912-89ee-45af-bff0-e5930fe89002 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.690730 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:24.691338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:24.697827 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.699090 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.700078 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.700524 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.740572 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:24.741329 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:24.742365 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lazy-loading 'fault' on Instance uuid f53bb255-30a9-4c8c-b637-c9f371b04944 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:40:24.815454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a11e7a0c33b4df38bdb713cffe43911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91da5641066242d99b74a660383a26da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:24.835112 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-42d80912-89ee-45af-bff0-e5930fe89002 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:24.835676 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2656fbb2-20f8-42d6-ae59-9406452387a4 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 200 len: 1311 microversion: 2.1 time: 0.148265 Dec 15 13:40:24.836237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 282/560] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:24 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:24.848060 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-42d80912-89ee-45af-bff0-e5930fe89002 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.326415 Dec 15 13:40:24.848925 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 279/561] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:24 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:25.000196 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-34fab63d-523b-40d2-aba5-d4d402707e26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:25.001117 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-34fab63d-523b-40d2-aba5-d4d402707e26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:25.007669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-34fab63d-523b-40d2-aba5-d4d402707e26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.007970 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-34fab63d-523b-40d2-aba5-d4d402707e26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.008761 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-34fab63d-523b-40d2-aba5-d4d402707e26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.009192 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-34fab63d-523b-40d2-aba5-d4d402707e26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.062057 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-34fab63d-523b-40d2-aba5-d4d402707e26 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066606 Dec 15 13:40:25.062988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 283/562] 10.222.0.83 () {60 vars in 1342 bytes} [Wed Dec 15 13:40:24 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:40:25.234977 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-4e9ec968-122a-451c-88ce-01af142dbec3 req-9feeb85a-6b09-4150-ba68-40b9eea84db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc679789-d368-43f8-ae73-af016defaac9", "tag": "8387272b-2814-444a-bddf-6d072a131977"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:25.236718 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:25.236718 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:40:25.252577 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-4e9ec968-122a-451c-88ce-01af142dbec3 req-9feeb85a-6b09-4150-ba68-40b9eea84db4 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.254451 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-4e9ec968-122a-451c-88ce-01af142dbec3 req-9feeb85a-6b09-4150-ba68-40b9eea84db4 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.267554 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-4e9ec968-122a-451c-88ce-01af142dbec3 req-9feeb85a-6b09-4150-ba68-40b9eea84db4 service nova] Creating event network-changed:8387272b-2814-444a-bddf-6d072a131977 for instance cc679789-d368-43f8-ae73-af016defaac9 on hv-cinder-81322 Dec 15 13:40:25.272858 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-4e9ec968-122a-451c-88ce-01af142dbec3 req-9feeb85a-6b09-4150-ba68-40b9eea84db4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043020 Dec 15 13:40:25.273626 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 280/563] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:25.855440 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:25.856088 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] [instance: f53bb255-30a9-4c8c-b637-c9f371b04944] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:25.862437 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.862972 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.863759 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.864186 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.866493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2d9b4e49-b54f-4129-9060-0ddad15aac48 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:25.867179 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2d9b4e49-b54f-4129-9060-0ddad15aac48 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:25.874020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d9b4e49-b54f-4129-9060-0ddad15aac48 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.874468 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d9b4e49-b54f-4129-9060-0ddad15aac48 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.875242 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d9b4e49-b54f-4129-9060-0ddad15aac48 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:25.875670 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d9b4e49-b54f-4129-9060-0ddad15aac48 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:25.878454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] HTTP exception thrown: Instance f53bb255-30a9-4c8c-b637-c9f371b04944 could not be found. Dec 15 13:40:25.879060 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] Returning 404 to user: Instance f53bb255-30a9-4c8c-b637-c9f371b04944 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:40:25.879875 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-294457aa-14d5-4b06-a906-842dc586cbd7 tempest-ServerRescueNegativeTestJSON-649309028 tempest-ServerRescueNegativeTestJSON-649309028-project] 10.222.0.83 "GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944" status: 404 len: 111 microversion: 2.1 time: 0.028731 Dec 15 13:40:25.880435 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 284/564] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:25 2021] GET /compute/v2.1/servers/f53bb255-30a9-4c8c-b637-c9f371b04944 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:40:26.073789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9f5784c4-1fc8-4ea2-8224-49aac87b830a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:26.074703 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9f5784c4-1fc8-4ea2-8224-49aac87b830a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:26.080509 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9f5784c4-1fc8-4ea2-8224-49aac87b830a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.080956 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9f5784c4-1fc8-4ea2-8224-49aac87b830a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.081731 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9f5784c4-1fc8-4ea2-8224-49aac87b830a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.082454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9f5784c4-1fc8-4ea2-8224-49aac87b830a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.112460 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9f5784c4-1fc8-4ea2-8224-49aac87b830a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042464 Dec 15 13:40:26.113032 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 285/565] 10.222.0.83 () {60 vars in 1342 bytes} [Wed Dec 15 13:40:26 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:26.170056 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-247c8fbb-55fe-4cc3-8d1e-f0d3a2d89456 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:26.170542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-247c8fbb-55fe-4cc3-8d1e-f0d3a2d89456 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:26.176924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-247c8fbb-55fe-4cc3-8d1e-f0d3a2d89456 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.177376 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-247c8fbb-55fe-4cc3-8d1e-f0d3a2d89456 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.178188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-247c8fbb-55fe-4cc3-8d1e-f0d3a2d89456 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.178625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-247c8fbb-55fe-4cc3-8d1e-f0d3a2d89456 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.204882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-247c8fbb-55fe-4cc3-8d1e-f0d3a2d89456 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:40:26.215257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2d9b4e49-b54f-4129-9060-0ddad15aac48 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:26.222834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2d9b4e49-b54f-4129-9060-0ddad15aac48 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.360127 Dec 15 13:40:26.223417 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 281/566] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:25 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:26.281634 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-247c8fbb-55fe-4cc3-8d1e-f0d3a2d89456 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "DELETE /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 204 len: 0 microversion: 2.20 time: 0.114825 Dec 15 13:40:26.289865 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 286/567] 10.222.0.83 () {60 vars in 1279 bytes} [Wed Dec 15 13:40:26 2021] DELETE /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 15 13:40:26.291790 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:26.292672 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:26.298700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.299154 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.299944 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:26.300415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:26.786533 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:26.794793 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:26.796287 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:26.797441 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-febc0d91-edfd-49bf-9b99-65c366efb212 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.510332 Dec 15 13:40:26.798034 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 282/568] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:26 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:27.239967 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-253bfa38-2d0b-43f6-b67a-cfda3eb7272c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:27.240656 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-253bfa38-2d0b-43f6-b67a-cfda3eb7272c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:27.247447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-253bfa38-2d0b-43f6-b67a-cfda3eb7272c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.247890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-253bfa38-2d0b-43f6-b67a-cfda3eb7272c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:27.249328 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-253bfa38-2d0b-43f6-b67a-cfda3eb7272c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.249958 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-253bfa38-2d0b-43f6-b67a-cfda3eb7272c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:27.498325 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-253bfa38-2d0b-43f6-b67a-cfda3eb7272c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:27.506259 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-253bfa38-2d0b-43f6-b67a-cfda3eb7272c tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.270186 Dec 15 13:40:27.516650 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 287/569] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:27 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:27.816186 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:27.816769 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:27.823360 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.823871 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:27.824553 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:27.824988 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.093626 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:28.101385 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:28.102995 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:28.104257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6b1e8cb2-61eb-4b84-86ff-f77c32ff8298 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.291748 Dec 15 13:40:28.106723 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 283/570] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:27 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:28.525685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c4af0773-cd22-4087-bb05-0c7fd9e8354a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:28.529113 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c4af0773-cd22-4087-bb05-0c7fd9e8354a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:28.537403 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c4af0773-cd22-4087-bb05-0c7fd9e8354a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:28.542579 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c4af0773-cd22-4087-bb05-0c7fd9e8354a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:28.542579 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c4af0773-cd22-4087-bb05-0c7fd9e8354a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:28.542579 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c4af0773-cd22-4087-bb05-0c7fd9e8354a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.123585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c4af0773-cd22-4087-bb05-0c7fd9e8354a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:29.123831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:29.125279 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:29.132313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.133255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.134492 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c4af0773-cd22-4087-bb05-0c7fd9e8354a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.612262 Dec 15 13:40:29.134492 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 288/571] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:28 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:29.135978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.136893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.302728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-0275c888-ffec-4a40-a031-d56a4e297ce7 req-73bd854f-a72c-4720-8ad8-6b0c048a09f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc679789-d368-43f8-ae73-af016defaac9", "name": "network-vif-plugged", "status": "completed", "tag": "8387272b-2814-444a-bddf-6d072a131977"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:29.307772 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:29.307772 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:29.368491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-0275c888-ffec-4a40-a031-d56a4e297ce7 req-73bd854f-a72c-4720-8ad8-6b0c048a09f2 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.370049 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-0275c888-ffec-4a40-a031-d56a4e297ce7 req-73bd854f-a72c-4720-8ad8-6b0c048a09f2 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.400987 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-0275c888-ffec-4a40-a031-d56a4e297ce7 req-73bd854f-a72c-4720-8ad8-6b0c048a09f2 service nova] Creating event network-vif-plugged:8387272b-2814-444a-bddf-6d072a131977 for instance cc679789-d368-43f8-ae73-af016defaac9 on hv-cinder-81322 Dec 15 13:40:29.407673 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-0275c888-ffec-4a40-a031-d56a4e297ce7 req-73bd854f-a72c-4720-8ad8-6b0c048a09f2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111360 Dec 15 13:40:29.411676 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 289/572] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:29.462980 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:29.476938 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:29.479903 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:29.483231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-631f53c3-b3d5-4fef-8400-7e1fd56754d0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 200 len: 1722 microversion: 2.20 time: 0.362278 Dec 15 13:40:29.495690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 284/573] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:29 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:40:29.773232 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-0278833e-2a04-4af5-a892-8cb81fbf309d req-148fa7f5-69cd-4062-ad06-e2fd0da8375b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16af4c97-7ce7-47dd-8493-24d19a46221d", "name": "network-vif-deleted", "tag": "e4b8c97b-020a-4806-8f09-f876ba55ad9d"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:29.775623 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:29.775623 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:29.791794 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-0278833e-2a04-4af5-a892-8cb81fbf309d req-148fa7f5-69cd-4062-ad06-e2fd0da8375b service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:29.792614 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-0278833e-2a04-4af5-a892-8cb81fbf309d req-148fa7f5-69cd-4062-ad06-e2fd0da8375b service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:29.817821 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-0278833e-2a04-4af5-a892-8cb81fbf309d req-148fa7f5-69cd-4062-ad06-e2fd0da8375b service nova] Creating event network-vif-deleted:e4b8c97b-020a-4806-8f09-f876ba55ad9d for instance 16af4c97-7ce7-47dd-8493-24d19a46221d on hv-cinder-81322 Dec 15 13:40:29.836840 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-0278833e-2a04-4af5-a892-8cb81fbf309d req-148fa7f5-69cd-4062-ad06-e2fd0da8375b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061300 Dec 15 13:40:29.839693 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 290/574] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:30.151666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-92f96f6c-8de6-48a5-9060-6ef07dff33ef tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:30.154194 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-92f96f6c-8de6-48a5-9060-6ef07dff33ef tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:30.172619 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92f96f6c-8de6-48a5-9060-6ef07dff33ef tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.173077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92f96f6c-8de6-48a5-9060-6ef07dff33ef tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.173918 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92f96f6c-8de6-48a5-9060-6ef07dff33ef tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.174345 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-92f96f6c-8de6-48a5-9060-6ef07dff33ef tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.395440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-92f96f6c-8de6-48a5-9060-6ef07dff33ef tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:30.404277 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-92f96f6c-8de6-48a5-9060-6ef07dff33ef tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1356 microversion: 2.1 time: 0.257222 Dec 15 13:40:30.405176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 285/575] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:30 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1356 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:30.503726 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:30.505101 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:30.512250 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.513022 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.514048 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:30.514945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:30.530021 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] HTTP exception thrown: Instance 16af4c97-7ce7-47dd-8493-24d19a46221d could not be found. Dec 15 13:40:30.531367 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Returning 404 to user: Instance 16af4c97-7ce7-47dd-8493-24d19a46221d could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:40:30.532807 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-25a07975-b8c7-45ef-82e4-3574a1d6da9c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 404 len: 111 microversion: 2.20 time: 0.033484 Dec 15 13:40:30.533791 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 291/576] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:30 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 15 13:40:30.545177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-eb721a9a-7840-4ef8-a7d5-20c8a5b5fb6d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '.version_select at 0x7fd79c8bb670>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:30.596418 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-eb721a9a-7840-4ef8-a7d5-20c8a5b5fb6d tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-131519193" status: 204 len: 0 microversion: 2.20 time: 0.058126 Dec 15 13:40:30.597568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 286/577] 10.222.0.83 () {60 vars in 1258 bytes} [Wed Dec 15 13:40:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-131519193 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:40:31.422349 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-599790e4-595a-4b68-9cd0-03a221fd81ec tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:31.423130 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-599790e4-595a-4b68-9cd0-03a221fd81ec tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:31.431873 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-599790e4-595a-4b68-9cd0-03a221fd81ec tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.432690 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-599790e4-595a-4b68-9cd0-03a221fd81ec tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.435120 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-599790e4-595a-4b68-9cd0-03a221fd81ec tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.435768 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-599790e4-595a-4b68-9cd0-03a221fd81ec tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.491777 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6e7149c0-d5f3-4b9e-bcc8-2e3aef13a16e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'create', calling method: .version_select at 0x7fd79caa74c0>, body: {"keypair": {"name": "tempest-keypair-1734225292"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:31.528902 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-6e7149c0-d5f3-4b9e-bcc8-2e3aef13a16e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'key_pairs'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:31.534971 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-6e7149c0-d5f3-4b9e-bcc8-2e3aef13a16e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for user 825dcf92d1b64c3d8a6c3e41cec2c836 and project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'key_pairs'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:31.606103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-599790e4-595a-4b68-9cd0-03a221fd81ec tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:31.614700 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-599790e4-595a-4b68-9cd0-03a221fd81ec tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1546 microversion: 2.1 time: 0.198060 Dec 15 13:40:31.615854 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 292/578] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:31 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:31.640050 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-21371de3-ddf6-4d17-bd66-741b51876674 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:31.640984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-21371de3-ddf6-4d17-bd66-741b51876674 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:31.647268 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-21371de3-ddf6-4d17-bd66-741b51876674 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.647715 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-21371de3-ddf6-4d17-bd66-741b51876674 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.648492 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-21371de3-ddf6-4d17-bd66-741b51876674 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.648921 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-21371de3-ddf6-4d17-bd66-741b51876674 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.791837 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-21371de3-ddf6-4d17-bd66-741b51876674 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:31.800813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-21371de3-ddf6-4d17-bd66-741b51876674 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1546 microversion: 2.1 time: 0.167832 Dec 15 13:40:31.801684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 293/579] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:31 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:31.819897 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:31.826617 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:31.826617 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:31.828364 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:31.829384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Searching by: {'deleted': False, 'project_id': '56ce01ca50734f87ad8566b49ea5292a'} {{(pid=122611) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 13:40:31.850368 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.854187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.858268 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:31.859044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:31.928500 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-6e7149c0-d5f3-4b9e-bcc8-2e3aef13a16e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'key_pairs'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:31.934486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-6e7149c0-d5f3-4b9e-bcc8-2e3aef13a16e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for user 825dcf92d1b64c3d8a6c3e41cec2c836 and project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'key_pairs'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:31.952228 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6e7149c0-d5f3-4b9e-bcc8-2e3aef13a16e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.464151 Dec 15 13:40:31.953420 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 287/580] 10.222.0.83 () {62 vars in 1198 bytes} [Wed Dec 15 13:40:31 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 466 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:40:31.981218 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.multi_cell_list [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 13:40:32.128792 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3ecec41d-bb45-45ec-a557-89be8075961b tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.313962 Dec 15 13:40:32.141109 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6b94a6c8-4736-421b-8fb5-ef91545b2e1a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:32.141721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6b94a6c8-4736-421b-8fb5-ef91545b2e1a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:32.145448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 294/581] 10.222.0.83 () {58 vars in 1124 bytes} [Wed Dec 15 13:40:31 2021] GET /compute/v2.1/servers => generated 342 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:32.150071 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b94a6c8-4736-421b-8fb5-ef91545b2e1a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.150523 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b94a6c8-4736-421b-8fb5-ef91545b2e1a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:32.152467 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b94a6c8-4736-421b-8fb5-ef91545b2e1a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:32.152617 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b94a6c8-4736-421b-8fb5-ef91545b2e1a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:32.396542 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6b94a6c8-4736-421b-8fb5-ef91545b2e1a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:32.411425 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6b94a6c8-4736-421b-8fb5-ef91545b2e1a tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1546 microversion: 2.1 time: 0.273233 Dec 15 13:40:32.412767 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 288/582] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:32 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1546 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:34.157962 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c2bacd0f-1a2f-4ad5-a8e1-289b7b7345a7 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4455d95a-6ebe-4f54-9c23-fcaebccf53fe"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:34.159150 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c2bacd0f-1a2f-4ad5-a8e1-289b7b7345a7 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:34.169292 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c2bacd0f-1a2f-4ad5-a8e1-289b7b7345a7 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:34.169988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c2bacd0f-1a2f-4ad5-a8e1-289b7b7345a7 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:34.171002 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c2bacd0f-1a2f-4ad5-a8e1-289b7b7345a7 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:34.171513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c2bacd0f-1a2f-4ad5-a8e1-289b7b7345a7 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:34.474041 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c2bacd0f-1a2f-4ad5-a8e1-289b7b7345a7 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "POST /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320548 Dec 15 13:40:34.477789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 295/583] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:40:34 2021] POST /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:34.694874 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1795884456", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a124ac63-e61f-437a-a1a8-96048fcd9353"}], "security_groups": [{"name": "tempest-securitygroup--1785468740"}], "key_name": "tempest-keypair-1734225292", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:34.858587 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] validate_networks() for [('a124ac63-e61f-437a-a1a8-96048fcd9353', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:40:35.512860 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:40:35.513274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:40:35.516680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:40:35.516680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:40:35.516680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:40:35.524898 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:35.525634 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:35.526568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:35.527532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:35.548083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:35.561335 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Getting quotas for user 825dcf92d1b64c3d8a6c3e41cec2c836 and project 0bddd6292c044cdb9eb8e5bba5ebd4fc. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:35.574759 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:40:35.577324 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:40:35.644775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-93e0d2ad-fdcb-449a-a6ba-44b1ca6dfcfb tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.954819 Dec 15 13:40:35.645717 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 289/584] 10.222.0.83 () {62 vars in 1187 bytes} [Wed Dec 15 13:40:34 2021] POST /compute/v2.1/servers => generated 402 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 13:40:35.657474 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-79891914-6143-4bea-a2ea-ea2d3d00e8c5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:35.658830 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-79891914-6143-4bea-a2ea-ea2d3d00e8c5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:35.770620 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-79891914-6143-4bea-a2ea-ea2d3d00e8c5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:35.782286 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-79891914-6143-4bea-a2ea-ea2d3d00e8c5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:35.784032 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-79891914-6143-4bea-a2ea-ea2d3d00e8c5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:35.785230 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-79891914-6143-4bea-a2ea-ea2d3d00e8c5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1282 microversion: 2.20 time: 0.132354 Dec 15 13:40:35.786148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 296/585] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:35 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:36.804987 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:36.805682 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:36.819661 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:36.820444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:36.821475 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:36.823097 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:36.971970 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:36.988592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:36.993671 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:36.994874 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cd639f78-80fb-4c7e-af6d-2f950152b7df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1352 microversion: 2.20 time: 0.194264 Dec 15 13:40:36.995516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 290/586] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:36 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:38.020556 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:38.021434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:38.031308 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.032205 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:38.033257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.034009 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:38.157663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-33fed673-471b-4d81-975b-71138a17e1fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'create', calling method: .version_select at 0x7fd79c0bf790>, body: {"keypair": {"name": "tempest-keypair-1041386510"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:38.180280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-33fed673-471b-4d81-975b-71138a17e1fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:38.186273 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-33fed673-471b-4d81-975b-71138a17e1fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for user 4c98a5d1c09e43c99bcbc1e9785d1edd and project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:38.240828 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:38.251249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:38.253121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:38.254607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ddf4e88b-8d50-467a-a91f-04324cb12e66 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1408 microversion: 2.20 time: 0.238321 Dec 15 13:40:38.270378 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 291/587] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:38 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:38.492530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-33fed673-471b-4d81-975b-71138a17e1fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:38.497774 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-33fed673-471b-4d81-975b-71138a17e1fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for user 4c98a5d1c09e43c99bcbc1e9785d1edd and project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'key_pairs'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:38.513941 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-33fed673-471b-4d81-975b-71138a17e1fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.603230 Dec 15 13:40:38.514954 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 297/588] 10.222.0.83 () {60 vars in 1157 bytes} [Wed Dec 15 13:40:37 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:38.905043 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-dabd32fd-a0d9-4333-acb2-47aee0fdd108 req-b1461423-c05c-4630-99a8-de6ea7bd8091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8832f44d-71e8-44e3-b955-88a3285a3cb2", "tag": "eb6d9258-9d98-4855-ac93-8388249d6cd9"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:38.907027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:38.907027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:40:38.914938 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-dabd32fd-a0d9-4333-acb2-47aee0fdd108 req-b1461423-c05c-4630-99a8-de6ea7bd8091 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:38.915670 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-dabd32fd-a0d9-4333-acb2-47aee0fdd108 req-b1461423-c05c-4630-99a8-de6ea7bd8091 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:38.929727 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-dabd32fd-a0d9-4333-acb2-47aee0fdd108 req-b1461423-c05c-4630-99a8-de6ea7bd8091 service nova] Creating event network-changed:eb6d9258-9d98-4855-ac93-8388249d6cd9 for instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 on hv-cinder-81322 Dec 15 13:40:38.940551 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-dabd32fd-a0d9-4333-acb2-47aee0fdd108 req-b1461423-c05c-4630-99a8-de6ea7bd8091 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037255 Dec 15 13:40:38.941805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 292/589] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:39.274215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:39.274760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:39.282479 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:39.288525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:39.289613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:39.290255 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:39.533567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:39.542010 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:39.544024 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:39.545433 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-48c8404c-2a66-4675-a337-26dc522a51fa tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1408 microversion: 2.20 time: 0.275156 Dec 15 13:40:39.556886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 298/590] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:39 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:40.098448 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1052282949", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83a3c4cb-56da-41d3-bc6c-42f445cbeed5"}], "security_groups": [{"name": "tempest-securitygroup--812440044"}], "key_name": "tempest-keypair-1041386510", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:40.232238 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] validate_networks() for [('83a3c4cb-56da-41d3-bc6c-42f445cbeed5', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:40:40.564522 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:40.565832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:40.574206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.574940 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.576256 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.577228 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.764337 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:40:40.764938 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:40:40.765570 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:40:40.766176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:40:40.766770 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:40:40.781212 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.781980 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.782804 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:40.783230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:40.801955 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:40:40.806555 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for user 4c98a5d1c09e43c99bcbc1e9785d1edd and project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:40:40.818121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:40:40.821146 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:40:40.861166 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:40.876579 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:40.879318 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:40.883079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-730e8a70-1f67-414c-ae89-2211beea4347 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.797086 Dec 15 13:40:40.883347 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-bb1df22f-8667-4eda-8eaa-681381d2eaef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1408 microversion: 2.20 time: 0.322286 Dec 15 13:40:40.885640 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 293/591] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:40:40 2021] POST /compute/v2.1/servers => generated 401 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:40:40.886930 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 299/592] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:40 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:40.895644 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-68bc3000-9c4b-4d67-9244-5e7cd727882d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:40.896480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-68bc3000-9c4b-4d67-9244-5e7cd727882d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:40.965825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-68bc3000-9c4b-4d67-9244-5e7cd727882d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:40.974658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-68bc3000-9c4b-4d67-9244-5e7cd727882d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1238 microversion: 2.1 time: 0.083193 Dec 15 13:40:40.975947 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 294/593] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:40 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:41.193427 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e9ca11e5-6e62-4ae2-9556-62b8692b0c73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:41.194133 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e9ca11e5-6e62-4ae2-9556-62b8692b0c73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:41.202179 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9ca11e5-6e62-4ae2-9556-62b8692b0c73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:41.203057 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9ca11e5-6e62-4ae2-9556-62b8692b0c73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.203871 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9ca11e5-6e62-4ae2-9556-62b8692b0c73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:41.204296 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9ca11e5-6e62-4ae2-9556-62b8692b0c73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.398891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e9ca11e5-6e62-4ae2-9556-62b8692b0c73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:41.410803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e9ca11e5-6e62-4ae2-9556-62b8692b0c73 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1592 microversion: 2.1 time: 0.223377 Dec 15 13:40:41.412263 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 300/594] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:41 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1592 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:41.910341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:41.911726 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:41.920445 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:41.921160 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.922449 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:41.922890 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:41.992374 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8a020f72-a647-44d2-9f03-c608ae284c75 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:41.993776 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8a020f72-a647-44d2-9f03-c608ae284c75 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:42.003318 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8a020f72-a647-44d2-9f03-c608ae284c75 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:42.004281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8a020f72-a647-44d2-9f03-c608ae284c75 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:42.005401 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8a020f72-a647-44d2-9f03-c608ae284c75 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:42.006084 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8a020f72-a647-44d2-9f03-c608ae284c75 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:42.095790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-8a020f72-a647-44d2-9f03-c608ae284c75 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:42.108587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8a020f72-a647-44d2-9f03-c608ae284c75 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1290 microversion: 2.1 time: 0.117234 Dec 15 13:40:42.110065 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 301/595] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:41 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:42.140062 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:42.151129 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:42.152778 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:42.159191 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8fb79bfb-2cdc-46cb-9ba0-acfc03a3d3d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1408 microversion: 2.20 time: 0.253356 Dec 15 13:40:42.160153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 295/596] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:41 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:43.128361 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-602815da-fff7-4f76-a406-e376a501a7a8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:43.129080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-602815da-fff7-4f76-a406-e376a501a7a8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:43.135959 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-602815da-fff7-4f76-a406-e376a501a7a8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.137057 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-602815da-fff7-4f76-a406-e376a501a7a8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.137730 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-602815da-fff7-4f76-a406-e376a501a7a8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.138224 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-602815da-fff7-4f76-a406-e376a501a7a8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.186535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:43.187143 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:43.193280 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.193722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.194529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.194980 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.224884 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-602815da-fff7-4f76-a406-e376a501a7a8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:43.232658 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-602815da-fff7-4f76-a406-e376a501a7a8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1296 microversion: 2.1 time: 0.108553 Dec 15 13:40:43.234600 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 302/597] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:43 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:43.351566 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-bb8d6e37-e060-44d3-b9a7-7312652cf9c9 req-7a4cfea4-65d8-46e1-8f62-dfce361e3921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8832f44d-71e8-44e3-b955-88a3285a3cb2", "name": "network-vif-plugged", "status": "completed", "tag": "eb6d9258-9d98-4855-ac93-8388249d6cd9"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:43.355591 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:43.355591 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:43.367835 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-bb8d6e37-e060-44d3-b9a7-7312652cf9c9 req-7a4cfea4-65d8-46e1-8f62-dfce361e3921 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:43.368528 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-bb8d6e37-e060-44d3-b9a7-7312652cf9c9 req-7a4cfea4-65d8-46e1-8f62-dfce361e3921 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:43.383710 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-bb8d6e37-e060-44d3-b9a7-7312652cf9c9 req-7a4cfea4-65d8-46e1-8f62-dfce361e3921 service nova] Creating event network-vif-plugged:eb6d9258-9d98-4855-ac93-8388249d6cd9 for instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 on hv-cinder-81322 Dec 15 13:40:43.389409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:43.391140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-bb8d6e37-e060-44d3-b9a7-7312652cf9c9 req-7a4cfea4-65d8-46e1-8f62-dfce361e3921 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046338 Dec 15 13:40:43.392538 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 303/598] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:43.398723 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:43.400864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:43.415704 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9df6910b-8ae1-4bf1-9317-0a6f45bf828b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1408 microversion: 2.20 time: 0.233064 Dec 15 13:40:43.436352 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 296/599] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:43 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:44.251165 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5b62a5b2-5922-4264-bb52-d3ccfc25816c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:44.252059 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5b62a5b2-5922-4264-bb52-d3ccfc25816c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:44.258458 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5b62a5b2-5922-4264-bb52-d3ccfc25816c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.258966 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5b62a5b2-5922-4264-bb52-d3ccfc25816c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:44.259761 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5b62a5b2-5922-4264-bb52-d3ccfc25816c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.260182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5b62a5b2-5922-4264-bb52-d3ccfc25816c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:44.394251 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5b62a5b2-5922-4264-bb52-d3ccfc25816c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:44.402970 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5b62a5b2-5922-4264-bb52-d3ccfc25816c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1363 microversion: 2.1 time: 0.155182 Dec 15 13:40:44.403551 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 304/600] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:44 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:44.434714 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:44.435382 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:44.441650 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.442126 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:44.442898 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.443334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:44.548785 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-8d509c47-7178-42d6-835f-e4442fc59efb req-a62f123c-6fd8-465e-8bca-f9e349aacd52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc679789-d368-43f8-ae73-af016defaac9", "tag": "8387272b-2814-444a-bddf-6d072a131977"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:44.553073 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:44.553073 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:44.563858 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-8d509c47-7178-42d6-835f-e4442fc59efb req-a62f123c-6fd8-465e-8bca-f9e349aacd52 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:44.564582 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-8d509c47-7178-42d6-835f-e4442fc59efb req-a62f123c-6fd8-465e-8bca-f9e349aacd52 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:44.578929 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-8d509c47-7178-42d6-835f-e4442fc59efb req-a62f123c-6fd8-465e-8bca-f9e349aacd52 service nova] Creating event network-changed:8387272b-2814-444a-bddf-6d072a131977 for instance cc679789-d368-43f8-ae73-af016defaac9 on hv-cinder-81322 Dec 15 13:40:44.587014 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-8d509c47-7178-42d6-835f-e4442fc59efb req-a62f123c-6fd8-465e-8bca-f9e349aacd52 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042598 Dec 15 13:40:44.587983 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 305/601] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:44.646789 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:44.665175 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:44.668382 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:44.669838 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-81034ecd-f5be-4695-8555-cd20e6e31266 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1408 microversion: 2.20 time: 0.238833 Dec 15 13:40:44.670952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 297/602] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:44 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:45.421119 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c9ade444-4949-4cd5-9dc1-ed9990aa3b94 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:45.422430 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c9ade444-4949-4cd5-9dc1-ed9990aa3b94 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:45.428919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9ade444-4949-4cd5-9dc1-ed9990aa3b94 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:45.429711 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9ade444-4949-4cd5-9dc1-ed9990aa3b94 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:45.431013 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9ade444-4949-4cd5-9dc1-ed9990aa3b94 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:45.431685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9ade444-4949-4cd5-9dc1-ed9990aa3b94 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:45.641338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c9ade444-4949-4cd5-9dc1-ed9990aa3b94 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:45.648991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c9ade444-4949-4cd5-9dc1-ed9990aa3b94 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1363 microversion: 2.1 time: 0.232599 Dec 15 13:40:45.659267 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 306/603] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:45 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:45.688486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:45.689927 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:45.696209 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:45.696865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:45.697805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:45.698119 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:45.849362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:45.859889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:45.861712 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:45.863076 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5760ee96-5545-4ee7-8741-ab5b6a5c5724 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1600 microversion: 2.20 time: 0.178270 Dec 15 13:40:45.863810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 298/604] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:40:45 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:40:45.882323 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-05b24f3b-b1bb-4ff9-a73d-a5c5ee07fa47 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:45.882885 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-05b24f3b-b1bb-4ff9-a73d-a5c5ee07fa47 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:45.890280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05b24f3b-b1bb-4ff9-a73d-a5c5ee07fa47 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:45.890738 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05b24f3b-b1bb-4ff9-a73d-a5c5ee07fa47 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:45.891697 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05b24f3b-b1bb-4ff9-a73d-a5c5ee07fa47 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:45.892349 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-05b24f3b-b1bb-4ff9-a73d-a5c5ee07fa47 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.013144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-05b24f3b-b1bb-4ff9-a73d-a5c5ee07fa47 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.134982 Dec 15 13:40:46.013965 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 307/605] 10.222.0.83 () {60 vars in 1315 bytes} [Wed Dec 15 13:40:45 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:40:46.233093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-139b15a4-e306-4301-a9bf-78e4e1986ba0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1827285349"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:46.233488 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-139b15a4-e306-4301-a9bf-78e4e1986ba0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:46.239633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-139b15a4-e306-4301-a9bf-78e4e1986ba0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.240083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-139b15a4-e306-4301-a9bf-78e4e1986ba0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.240857 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-139b15a4-e306-4301-a9bf-78e4e1986ba0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.241373 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-139b15a4-e306-4301-a9bf-78e4e1986ba0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.374878 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.network.security_group_api [None req-139b15a4-e306-4301-a9bf-78e4e1986ba0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Adding security group 1b1801e8-b446-414a-b87d-240ff8a78350 to port 8387272b-2814-444a-bddf-6d072a131977 Dec 15 13:40:46.612016 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-c1e801ae-a287-43a7-acd8-537945947393 req-7cba4654-b3f7-41c4-8e9e-a154f13f737e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09248873-3a26-46a0-bbd1-b3574f74bc7a", "tag": "7ec98862-6702-437c-a8ca-fe7bcaf393ab"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:46.613520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:46.613520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:46.620704 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-c1e801ae-a287-43a7-acd8-537945947393 req-7cba4654-b3f7-41c4-8e9e-a154f13f737e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.621144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-c1e801ae-a287-43a7-acd8-537945947393 req-7cba4654-b3f7-41c4-8e9e-a154f13f737e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.632550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-c1e801ae-a287-43a7-acd8-537945947393 req-7cba4654-b3f7-41c4-8e9e-a154f13f737e service nova] Creating event network-changed:7ec98862-6702-437c-a8ca-fe7bcaf393ab for instance 09248873-3a26-46a0-bbd1-b3574f74bc7a on hv-cinder-81322 Dec 15 13:40:46.638080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-c1e801ae-a287-43a7-acd8-537945947393 req-7cba4654-b3f7-41c4-8e9e-a154f13f737e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030030 Dec 15 13:40:46.639124 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 308/606] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:46.666945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ae2e9520-0168-4143-ae49-a81eb2e1da7d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:46.667672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ae2e9520-0168-4143-ae49-a81eb2e1da7d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:46.674713 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ae2e9520-0168-4143-ae49-a81eb2e1da7d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.675491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ae2e9520-0168-4143-ae49-a81eb2e1da7d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.676640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ae2e9520-0168-4143-ae49-a81eb2e1da7d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.677241 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ae2e9520-0168-4143-ae49-a81eb2e1da7d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.778816 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-139b15a4-e306-4301-a9bf-78e4e1986ba0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "POST /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/action" status: 202 len: 0 microversion: 2.1 time: 0.550036 Dec 15 13:40:46.779728 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 299/607] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:46 2021] POST /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:46.788074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-50da31c2-7e42-41e4-bee3-ef8378f24267 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:46.788686 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-50da31c2-7e42-41e4-bee3-ef8378f24267 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:46.794954 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-50da31c2-7e42-41e4-bee3-ef8378f24267 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.795611 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-50da31c2-7e42-41e4-bee3-ef8378f24267 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:46.796775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-50da31c2-7e42-41e4-bee3-ef8378f24267 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:46.797385 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-50da31c2-7e42-41e4-bee3-ef8378f24267 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:47.029337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ae2e9520-0168-4143-ae49-a81eb2e1da7d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:47.040919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ae2e9520-0168-4143-ae49-a81eb2e1da7d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1363 microversion: 2.1 time: 0.378103 Dec 15 13:40:47.041789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 309/608] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:46 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:47.047070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-3690e17e-a31a-4768-8274-50f8f152ecfe req-158b48f7-aeab-4a5d-aefd-203a81b4bbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc679789-d368-43f8-ae73-af016defaac9", "tag": "8387272b-2814-444a-bddf-6d072a131977"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:47.056488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:47.056488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:47.063540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-50da31c2-7e42-41e4-bee3-ef8378f24267 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:47.072437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-50da31c2-7e42-41e4-bee3-ef8378f24267 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1757 microversion: 2.1 time: 0.287841 Dec 15 13:40:47.076385 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 300/609] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:46 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1757 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:47.093635 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-3690e17e-a31a-4768-8274-50f8f152ecfe req-158b48f7-aeab-4a5d-aefd-203a81b4bbcb service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:47.094419 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-3690e17e-a31a-4768-8274-50f8f152ecfe req-158b48f7-aeab-4a5d-aefd-203a81b4bbcb service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:47.114251 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-3690e17e-a31a-4768-8274-50f8f152ecfe req-158b48f7-aeab-4a5d-aefd-203a81b4bbcb service nova] Creating event network-changed:8387272b-2814-444a-bddf-6d072a131977 for instance cc679789-d368-43f8-ae73-af016defaac9 on hv-cinder-81322 Dec 15 13:40:47.120052 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-3690e17e-a31a-4768-8274-50f8f152ecfe req-158b48f7-aeab-4a5d-aefd-203a81b4bbcb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076669 Dec 15 13:40:47.121081 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 310/610] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:47.385451 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-31f1d79b-f1d9-44f2-872f-6bd49d7ac6d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:47.387003 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-31f1d79b-f1d9-44f2-872f-6bd49d7ac6d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:47.393183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-31f1d79b-f1d9-44f2-872f-6bd49d7ac6d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:47.393887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-31f1d79b-f1d9-44f2-872f-6bd49d7ac6d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:47.395002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-31f1d79b-f1d9-44f2-872f-6bd49d7ac6d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:47.395442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-31f1d79b-f1d9-44f2-872f-6bd49d7ac6d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:47.468844 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-31f1d79b-f1d9-44f2-872f-6bd49d7ac6d7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.086957 Dec 15 13:40:47.470221 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 301/611] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:47 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:48.059386 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-91333a19-60f6-4d11-9f33-d635ce84f724 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:48.060119 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-91333a19-60f6-4d11-9f33-d635ce84f724 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:48.066573 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-91333a19-60f6-4d11-9f33-d635ce84f724 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.067029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-91333a19-60f6-4d11-9f33-d635ce84f724 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.067810 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-91333a19-60f6-4d11-9f33-d635ce84f724 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.068244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-91333a19-60f6-4d11-9f33-d635ce84f724 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.208689 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-91333a19-60f6-4d11-9f33-d635ce84f724 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:48.219689 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-91333a19-60f6-4d11-9f33-d635ce84f724 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1363 microversion: 2.1 time: 0.164664 Dec 15 13:40:48.222006 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 311/612] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:48 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:48.482057 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8520cea4-257e-4ff6-bd8e-d4d82180d833 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:48.483096 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8520cea4-257e-4ff6-bd8e-d4d82180d833 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:48.490045 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8520cea4-257e-4ff6-bd8e-d4d82180d833 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.490500 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8520cea4-257e-4ff6-bd8e-d4d82180d833 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.491400 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8520cea4-257e-4ff6-bd8e-d4d82180d833 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.492273 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8520cea4-257e-4ff6-bd8e-d4d82180d833 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.562911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8520cea4-257e-4ff6-bd8e-d4d82180d833 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.085618 Dec 15 13:40:48.563569 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 302/613] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:48 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:48.653863 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-ba956d96-a368-4a18-bc0e-013b99833238 req-06c53278-6f00-46bd-a04b-8172ea12ba0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8832f44d-71e8-44e3-b955-88a3285a3cb2", "tag": "eb6d9258-9d98-4855-ac93-8388249d6cd9"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:48.655511 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:48.655511 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:48.662497 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-ba956d96-a368-4a18-bc0e-013b99833238 req-06c53278-6f00-46bd-a04b-8172ea12ba0a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:48.662931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-ba956d96-a368-4a18-bc0e-013b99833238 req-06c53278-6f00-46bd-a04b-8172ea12ba0a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:48.673555 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-ba956d96-a368-4a18-bc0e-013b99833238 req-06c53278-6f00-46bd-a04b-8172ea12ba0a service nova] Creating event network-changed:eb6d9258-9d98-4855-ac93-8388249d6cd9 for instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 on hv-cinder-81322 Dec 15 13:40:48.678427 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-ba956d96-a368-4a18-bc0e-013b99833238 req-06c53278-6f00-46bd-a04b-8172ea12ba0a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028762 Dec 15 13:40:48.678948 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 312/614] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:49.243590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-668f9e5c-d02a-471e-8688-5e3239339595 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:49.244352 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-668f9e5c-d02a-471e-8688-5e3239339595 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:49.252109 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-668f9e5c-d02a-471e-8688-5e3239339595 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.252687 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-668f9e5c-d02a-471e-8688-5e3239339595 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.253501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-668f9e5c-d02a-471e-8688-5e3239339595 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.253972 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-668f9e5c-d02a-471e-8688-5e3239339595 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.477156 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-668f9e5c-d02a-471e-8688-5e3239339595 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:49.487578 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-668f9e5c-d02a-471e-8688-5e3239339595 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1363 microversion: 2.1 time: 0.248022 Dec 15 13:40:49.488630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 303/615] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:49 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:49.574886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3cb26057-0ced-44ef-86df-71698dd8a0e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:49.575868 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3cb26057-0ced-44ef-86df-71698dd8a0e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:49.582017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3cb26057-0ced-44ef-86df-71698dd8a0e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.582431 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3cb26057-0ced-44ef-86df-71698dd8a0e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.583451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3cb26057-0ced-44ef-86df-71698dd8a0e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:49.583891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3cb26057-0ced-44ef-86df-71698dd8a0e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:49.641199 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3cb26057-0ced-44ef-86df-71698dd8a0e7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.070653 Dec 15 13:40:49.641853 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 313/616] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:49 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:50.505278 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-96cdcf47-cabf-4dff-8912-d113923e4d74 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:50.505914 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-96cdcf47-cabf-4dff-8912-d113923e4d74 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:50.512721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-96cdcf47-cabf-4dff-8912-d113923e4d74 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.513164 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-96cdcf47-cabf-4dff-8912-d113923e4d74 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.513981 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-96cdcf47-cabf-4dff-8912-d113923e4d74 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.514416 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-96cdcf47-cabf-4dff-8912-d113923e4d74 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.647379 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-96cdcf47-cabf-4dff-8912-d113923e4d74 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:50.652627 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b0908714-4648-4e6e-bc83-e884e863e033 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:50.654163 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b0908714-4648-4e6e-bc83-e884e863e033 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:50.655962 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-96cdcf47-cabf-4dff-8912-d113923e4d74 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1363 microversion: 2.1 time: 0.154304 Dec 15 13:40:50.656732 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 304/617] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:50 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:50.661354 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b0908714-4648-4e6e-bc83-e884e863e033 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.661819 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b0908714-4648-4e6e-bc83-e884e863e033 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.662599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b0908714-4648-4e6e-bc83-e884e863e033 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:50.663026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b0908714-4648-4e6e-bc83-e884e863e033 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:50.735169 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b0908714-4648-4e6e-bc83-e884e863e033 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.086354 Dec 15 13:40:50.735794 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 314/618] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:50 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:51.342461 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-2b21b2d6-581a-478b-8d3a-15170dfde01d req-73130d85-5add-4fbc-a68e-bc87f1d35a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09248873-3a26-46a0-bbd1-b3574f74bc7a", "name": "network-vif-plugged", "status": "completed", "tag": "7ec98862-6702-437c-a8ca-fe7bcaf393ab"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:51.344101 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:51.344101 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:40:51.351944 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-2b21b2d6-581a-478b-8d3a-15170dfde01d req-73130d85-5add-4fbc-a68e-bc87f1d35a13 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.352353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-2b21b2d6-581a-478b-8d3a-15170dfde01d req-73130d85-5add-4fbc-a68e-bc87f1d35a13 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.365413 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-2b21b2d6-581a-478b-8d3a-15170dfde01d req-73130d85-5add-4fbc-a68e-bc87f1d35a13 service nova] Creating event network-vif-plugged:7ec98862-6702-437c-a8ca-fe7bcaf393ab for instance 09248873-3a26-46a0-bbd1-b3574f74bc7a on hv-cinder-81322 Dec 15 13:40:51.370233 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-2b21b2d6-581a-478b-8d3a-15170dfde01d req-73130d85-5add-4fbc-a68e-bc87f1d35a13 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032315 Dec 15 13:40:51.370924 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 305/619] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:51.673224 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c9f1d39e-820c-4cc3-b085-31cf34957dc7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:51.673945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c9f1d39e-820c-4cc3-b085-31cf34957dc7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:51.680961 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9f1d39e-820c-4cc3-b085-31cf34957dc7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.681404 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9f1d39e-820c-4cc3-b085-31cf34957dc7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.682226 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9f1d39e-820c-4cc3-b085-31cf34957dc7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.682659 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9f1d39e-820c-4cc3-b085-31cf34957dc7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.746886 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-654330e7-130c-4971-91ff-0178920bacb0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:51.748222 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-654330e7-130c-4971-91ff-0178920bacb0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:51.754881 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-654330e7-130c-4971-91ff-0178920bacb0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.755521 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-654330e7-130c-4971-91ff-0178920bacb0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.756343 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-654330e7-130c-4971-91ff-0178920bacb0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:51.756875 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-654330e7-130c-4971-91ff-0178920bacb0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:51.823778 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c9f1d39e-820c-4cc3-b085-31cf34957dc7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:51.828055 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-654330e7-130c-4971-91ff-0178920bacb0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.085377 Dec 15 13:40:51.832489 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 306/620] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:51 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:51.833819 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c9f1d39e-820c-4cc3-b085-31cf34957dc7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1363 microversion: 2.1 time: 0.164282 Dec 15 13:40:51.834482 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 315/621] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:51 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:52.842343 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1a9b7357-4b95-4b36-b106-7628087298df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:52.843483 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1a9b7357-4b95-4b36-b106-7628087298df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:52.851049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1a9b7357-4b95-4b36-b106-7628087298df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.851573 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1a9b7357-4b95-4b36-b106-7628087298df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.852357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b8a5e769-984b-4edc-a024-a6ef67029825 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:52.852813 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1a9b7357-4b95-4b36-b106-7628087298df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.852967 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b8a5e769-984b-4edc-a024-a6ef67029825 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:52.853068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1a9b7357-4b95-4b36-b106-7628087298df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.860099 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b8a5e769-984b-4edc-a024-a6ef67029825 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.860888 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b8a5e769-984b-4edc-a024-a6ef67029825 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.861749 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b8a5e769-984b-4edc-a024-a6ef67029825 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:52.862359 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b8a5e769-984b-4edc-a024-a6ef67029825 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:52.924700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1a9b7357-4b95-4b36-b106-7628087298df tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.087310 Dec 15 13:40:52.925337 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 307/622] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:52 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:52.994363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b8a5e769-984b-4edc-a024-a6ef67029825 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:40:53.001623 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b8a5e769-984b-4edc-a024-a6ef67029825 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1549 microversion: 2.1 time: 0.154271 Dec 15 13:40:53.002218 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 316/623] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:40:52 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:53.017996 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-aa08ae01-db3e-465c-b9c6-af3c1a7266cc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:40:53.018561 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-aa08ae01-db3e-465c-b9c6-af3c1a7266cc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:53.025323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aa08ae01-db3e-465c-b9c6-af3c1a7266cc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:53.025783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aa08ae01-db3e-465c-b9c6-af3c1a7266cc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:53.026558 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aa08ae01-db3e-465c-b9c6-af3c1a7266cc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:53.027480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-aa08ae01-db3e-465c-b9c6-af3c1a7266cc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:53.108754 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-aa08ae01-db3e-465c-b9c6-af3c1a7266cc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094708 Dec 15 13:40:53.109335 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 308/624] 10.222.0.83 () {58 vars in 1274 bytes} [Wed Dec 15 13:40:53 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:40:53.936338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d77a9fd8-0e22-4fec-baec-0ea24c217d12 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:53.937254 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d77a9fd8-0e22-4fec-baec-0ea24c217d12 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:53.943587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d77a9fd8-0e22-4fec-baec-0ea24c217d12 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:53.944037 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d77a9fd8-0e22-4fec-baec-0ea24c217d12 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:53.944828 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d77a9fd8-0e22-4fec-baec-0ea24c217d12 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:53.945262 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d77a9fd8-0e22-4fec-baec-0ea24c217d12 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:54.007391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d77a9fd8-0e22-4fec-baec-0ea24c217d12 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.075345 Dec 15 13:40:54.008038 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 317/625] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:53 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:54.047410 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-69797c0b-19d7-4938-816a-0970c2f91657 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:54.049151 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-69797c0b-19d7-4938-816a-0970c2f91657 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:54.050452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-a902c627-53f1-407c-b66a-8b95ae66e477 req-4b153488-1b7e-4be4-baf7-cee8ef1b1e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09248873-3a26-46a0-bbd1-b3574f74bc7a", "tag": "7ec98862-6702-437c-a8ca-fe7bcaf393ab"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:54.051915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:40:54.051915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:40:54.056409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-69797c0b-19d7-4938-816a-0970c2f91657 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:54.056951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-69797c0b-19d7-4938-816a-0970c2f91657 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:54.057895 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-69797c0b-19d7-4938-816a-0970c2f91657 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:54.058959 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-69797c0b-19d7-4938-816a-0970c2f91657 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:54.060735 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-a902c627-53f1-407c-b66a-8b95ae66e477 req-4b153488-1b7e-4be4-baf7-cee8ef1b1e08 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:54.063182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-a902c627-53f1-407c-b66a-8b95ae66e477 req-4b153488-1b7e-4be4-baf7-cee8ef1b1e08 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:54.072707 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-a902c627-53f1-407c-b66a-8b95ae66e477 req-4b153488-1b7e-4be4-baf7-cee8ef1b1e08 service nova] Creating event network-changed:7ec98862-6702-437c-a8ca-fe7bcaf393ab for instance 09248873-3a26-46a0-bbd1-b3574f74bc7a on hv-cinder-81322 Dec 15 13:40:54.077606 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-a902c627-53f1-407c-b66a-8b95ae66e477 req-4b153488-1b7e-4be4-baf7-cee8ef1b1e08 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030971 Dec 15 13:40:54.078231 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 318/626] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:40:54.126063 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-69797c0b-19d7-4938-816a-0970c2f91657 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.083361 Dec 15 13:40:54.129731 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 309/627] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:54 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:40:55.019932 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-33a58507-023f-4173-bd78-5ee41a9df57c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:55.020930 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-33a58507-023f-4173-bd78-5ee41a9df57c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:55.027033 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-33a58507-023f-4173-bd78-5ee41a9df57c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:55.027476 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-33a58507-023f-4173-bd78-5ee41a9df57c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:55.028252 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-33a58507-023f-4173-bd78-5ee41a9df57c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:55.028699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-33a58507-023f-4173-bd78-5ee41a9df57c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:55.090762 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-33a58507-023f-4173-bd78-5ee41a9df57c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.074733 Dec 15 13:40:55.091609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 319/628] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:55 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:55.137712 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b5c96aac-9f9d-4bd7-b582-67e54388f4d3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:55.138631 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b5c96aac-9f9d-4bd7-b582-67e54388f4d3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:55.145545 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b5c96aac-9f9d-4bd7-b582-67e54388f4d3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:55.146017 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b5c96aac-9f9d-4bd7-b582-67e54388f4d3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:55.146815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b5c96aac-9f9d-4bd7-b582-67e54388f4d3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:55.147243 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b5c96aac-9f9d-4bd7-b582-67e54388f4d3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:55.206080 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b5c96aac-9f9d-4bd7-b582-67e54388f4d3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.072951 Dec 15 13:40:55.206620 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 310/629] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:55 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:40:56.101898 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-861fbf9d-3e5b-4bd1-bdad-52c76c71eeed tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:56.102912 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-861fbf9d-3e5b-4bd1-bdad-52c76c71eeed tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:56.110221 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-861fbf9d-3e5b-4bd1-bdad-52c76c71eeed tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:56.110668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-861fbf9d-3e5b-4bd1-bdad-52c76c71eeed tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:56.111438 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-861fbf9d-3e5b-4bd1-bdad-52c76c71eeed tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:56.111871 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-861fbf9d-3e5b-4bd1-bdad-52c76c71eeed tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:56.176287 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-861fbf9d-3e5b-4bd1-bdad-52c76c71eeed tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.078304 Dec 15 13:40:56.176912 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 320/630] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:56 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:56.216612 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b4480634-0f9b-455e-84fc-8d63ca4a33b3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:56.217588 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b4480634-0f9b-455e-84fc-8d63ca4a33b3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:56.224862 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4480634-0f9b-455e-84fc-8d63ca4a33b3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:56.225303 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4480634-0f9b-455e-84fc-8d63ca4a33b3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:56.226089 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4480634-0f9b-455e-84fc-8d63ca4a33b3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:56.226514 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4480634-0f9b-455e-84fc-8d63ca4a33b3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:56.297133 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b4480634-0f9b-455e-84fc-8d63ca4a33b3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.084151 Dec 15 13:40:56.297656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 311/631] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:56 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:40:57.187541 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fd23421b-8ea4-458e-92d2-9e814c98e75e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:57.188519 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fd23421b-8ea4-458e-92d2-9e814c98e75e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:57.195598 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd23421b-8ea4-458e-92d2-9e814c98e75e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:57.196041 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd23421b-8ea4-458e-92d2-9e814c98e75e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:57.196803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd23421b-8ea4-458e-92d2-9e814c98e75e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:57.197232 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd23421b-8ea4-458e-92d2-9e814c98e75e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:57.260436 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fd23421b-8ea4-458e-92d2-9e814c98e75e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.077443 Dec 15 13:40:57.261068 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 321/632] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:57 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:40:57.308782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-01cad46c-a7b5-4d45-ae4f-9931bc4e0bfc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:57.309727 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-01cad46c-a7b5-4d45-ae4f-9931bc4e0bfc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:57.316612 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-01cad46c-a7b5-4d45-ae4f-9931bc4e0bfc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:57.317063 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-01cad46c-a7b5-4d45-ae4f-9931bc4e0bfc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:57.317870 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-01cad46c-a7b5-4d45-ae4f-9931bc4e0bfc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:57.318308 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-01cad46c-a7b5-4d45-ae4f-9931bc4e0bfc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:57.381908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-01cad46c-a7b5-4d45-ae4f-9931bc4e0bfc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.077065 Dec 15 13:40:57.382550 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 312/633] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:57 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:40:58.272055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1a81b709-905f-4e1c-9609-86e587e23195 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:58.272984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1a81b709-905f-4e1c-9609-86e587e23195 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:58.279712 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1a81b709-905f-4e1c-9609-86e587e23195 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:58.280148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1a81b709-905f-4e1c-9609-86e587e23195 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:58.280905 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1a81b709-905f-4e1c-9609-86e587e23195 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:58.281328 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1a81b709-905f-4e1c-9609-86e587e23195 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:58.342821 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1a81b709-905f-4e1c-9609-86e587e23195 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 14 microversion: 2.20 time: 0.074784 Dec 15 13:40:58.343436 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 322/634] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:58 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:40:58.392930 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-710ca17d-67e4-49c1-9c57-55fc9cad633f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:58.393935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-710ca17d-67e4-49c1-9c57-55fc9cad633f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:58.400687 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-710ca17d-67e4-49c1-9c57-55fc9cad633f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:58.401125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-710ca17d-67e4-49c1-9c57-55fc9cad633f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:58.401911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-710ca17d-67e4-49c1-9c57-55fc9cad633f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:58.402388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-710ca17d-67e4-49c1-9c57-55fc9cad633f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:58.467027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-710ca17d-67e4-49c1-9c57-55fc9cad633f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.077874 Dec 15 13:40:58.467637 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 313/635] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:58 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:40:59.354264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0b571e51-b1e9-4b0a-a998-89bc81ba8ee6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:59.355374 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0b571e51-b1e9-4b0a-a998-89bc81ba8ee6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:59.362659 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b571e51-b1e9-4b0a-a998-89bc81ba8ee6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:59.363111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b571e51-b1e9-4b0a-a998-89bc81ba8ee6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:59.363931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b571e51-b1e9-4b0a-a998-89bc81ba8ee6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:59.364392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b571e51-b1e9-4b0a-a998-89bc81ba8ee6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:59.437336 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0b571e51-b1e9-4b0a-a998-89bc81ba8ee6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 11454 microversion: 2.20 time: 0.087029 Dec 15 13:40:59.438221 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 323/636] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:40:59 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 11454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:40:59.478246 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b8fd294e-b0d9-4d74-af8c-6a19af992dbd tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:40:59.479252 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b8fd294e-b0d9-4d74-af8c-6a19af992dbd tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:40:59.486096 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b8fd294e-b0d9-4d74-af8c-6a19af992dbd tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:59.486576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b8fd294e-b0d9-4d74-af8c-6a19af992dbd tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:59.487351 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b8fd294e-b0d9-4d74-af8c-6a19af992dbd tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:40:59.487783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b8fd294e-b0d9-4d74-af8c-6a19af992dbd tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:40:59.567025 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b8fd294e-b0d9-4d74-af8c-6a19af992dbd tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.092654 Dec 15 13:40:59.567666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 314/637] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:40:59 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:41:00.449039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ce81058a-8b0c-4538-a9f5-29e0e50abba0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:00.450081 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ce81058a-8b0c-4538-a9f5-29e0e50abba0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:00.457116 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ce81058a-8b0c-4538-a9f5-29e0e50abba0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:00.457560 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ce81058a-8b0c-4538-a9f5-29e0e50abba0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:00.458355 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ce81058a-8b0c-4538-a9f5-29e0e50abba0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:00.459037 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ce81058a-8b0c-4538-a9f5-29e0e50abba0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:00.535591 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ce81058a-8b0c-4538-a9f5-29e0e50abba0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 17355 microversion: 2.20 time: 0.090450 Dec 15 13:41:00.536330 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 324/638] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:00 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 17355 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:00.579589 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b20acbc2-bafd-4f01-921b-8a407161a7f7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:00.580595 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b20acbc2-bafd-4f01-921b-8a407161a7f7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:00.587679 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b20acbc2-bafd-4f01-921b-8a407161a7f7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:00.588149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b20acbc2-bafd-4f01-921b-8a407161a7f7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:00.588922 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b20acbc2-bafd-4f01-921b-8a407161a7f7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:00.589355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b20acbc2-bafd-4f01-921b-8a407161a7f7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:00.653924 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b20acbc2-bafd-4f01-921b-8a407161a7f7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.078221 Dec 15 13:41:00.655113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 315/639] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:00 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:41:01.547653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-427831bf-f502-467f-8129-857e10072ff1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:01.548632 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-427831bf-f502-467f-8129-857e10072ff1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:01.555358 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-427831bf-f502-467f-8129-857e10072ff1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:01.555795 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-427831bf-f502-467f-8129-857e10072ff1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:01.556550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-427831bf-f502-467f-8129-857e10072ff1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:01.556971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-427831bf-f502-467f-8129-857e10072ff1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:01.635922 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-427831bf-f502-467f-8129-857e10072ff1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 18356 microversion: 2.20 time: 0.092181 Dec 15 13:41:01.637026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 325/640] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:01 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 18356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:01.664738 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-be15ccc5-29b5-4a5c-a140-1e271316f9aa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:01.665734 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-be15ccc5-29b5-4a5c-a140-1e271316f9aa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:01.674082 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-be15ccc5-29b5-4a5c-a140-1e271316f9aa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:01.674534 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-be15ccc5-29b5-4a5c-a140-1e271316f9aa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:01.675305 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-be15ccc5-29b5-4a5c-a140-1e271316f9aa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:01.675736 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-be15ccc5-29b5-4a5c-a140-1e271316f9aa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:01.735327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-be15ccc5-29b5-4a5c-a140-1e271316f9aa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.074446 Dec 15 13:41:01.735933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 316/641] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:01 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:41:02.648274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-08cdbf92-b54c-4e5a-96af-b00594ba1a79 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:02.649289 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-08cdbf92-b54c-4e5a-96af-b00594ba1a79 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:02.656580 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08cdbf92-b54c-4e5a-96af-b00594ba1a79 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:02.656707 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08cdbf92-b54c-4e5a-96af-b00594ba1a79 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:02.657448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08cdbf92-b54c-4e5a-96af-b00594ba1a79 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:02.657915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-08cdbf92-b54c-4e5a-96af-b00594ba1a79 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:02.746647 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f0d84f1c-ea09-49f6-8945-7c8d4bcfef66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:02.747226 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-08cdbf92-b54c-4e5a-96af-b00594ba1a79 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 20874 microversion: 2.20 time: 0.102011 Dec 15 13:41:02.747472 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 326/642] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:02 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 20874 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:02.747674 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f0d84f1c-ea09-49f6-8945-7c8d4bcfef66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:02.754911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f0d84f1c-ea09-49f6-8945-7c8d4bcfef66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:02.755358 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f0d84f1c-ea09-49f6-8945-7c8d4bcfef66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:02.756139 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f0d84f1c-ea09-49f6-8945-7c8d4bcfef66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:02.756571 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f0d84f1c-ea09-49f6-8945-7c8d4bcfef66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:02.819733 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f0d84f1c-ea09-49f6-8945-7c8d4bcfef66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.077490 Dec 15 13:41:02.820536 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 317/643] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:02 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:41:03.758863 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-00b84fa9-dc26-4a64-92ed-a707a8bcbf51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:03.759847 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-00b84fa9-dc26-4a64-92ed-a707a8bcbf51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:03.767175 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-00b84fa9-dc26-4a64-92ed-a707a8bcbf51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:03.767613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-00b84fa9-dc26-4a64-92ed-a707a8bcbf51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:03.768374 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-00b84fa9-dc26-4a64-92ed-a707a8bcbf51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:03.768802 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-00b84fa9-dc26-4a64-92ed-a707a8bcbf51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:03.832216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f72a5f54-c540-4e77-9c4d-ec6b571cab4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:03.833234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f72a5f54-c540-4e77-9c4d-ec6b571cab4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:03.840603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f72a5f54-c540-4e77-9c4d-ec6b571cab4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:03.841051 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f72a5f54-c540-4e77-9c4d-ec6b571cab4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:03.841866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f72a5f54-c540-4e77-9c4d-ec6b571cab4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:03.842303 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f72a5f54-c540-4e77-9c4d-ec6b571cab4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:03.848640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-00b84fa9-dc26-4a64-92ed-a707a8bcbf51 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 22715 microversion: 2.20 time: 0.093565 Dec 15 13:41:03.853918 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 327/644] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:03 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 22715 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:41:03.906144 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f72a5f54-c540-4e77-9c4d-ec6b571cab4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.078150 Dec 15 13:41:03.906858 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 318/645] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:03 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:41:04.862867 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-efac906e-a165-44a1-8b8b-8189787ea713 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:04.863475 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-efac906e-a165-44a1-8b8b-8189787ea713 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:04.870044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-efac906e-a165-44a1-8b8b-8189787ea713 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:04.870485 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-efac906e-a165-44a1-8b8b-8189787ea713 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:04.871743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-efac906e-a165-44a1-8b8b-8189787ea713 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:04.872166 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-efac906e-a165-44a1-8b8b-8189787ea713 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:04.916936 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9a17b9ae-0fca-4364-8bae-9423e3d65ca7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:04.917880 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9a17b9ae-0fca-4364-8bae-9423e3d65ca7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:04.924586 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a17b9ae-0fca-4364-8bae-9423e3d65ca7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:04.925037 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a17b9ae-0fca-4364-8bae-9423e3d65ca7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:04.925841 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a17b9ae-0fca-4364-8bae-9423e3d65ca7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:04.926278 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a17b9ae-0fca-4364-8bae-9423e3d65ca7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:04.947931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-efac906e-a165-44a1-8b8b-8189787ea713 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 23803 microversion: 2.20 time: 0.089640 Dec 15 13:41:04.952467 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 328/646] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:04 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 23803 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:41:04.988474 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9a17b9ae-0fca-4364-8bae-9423e3d65ca7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 14 microversion: 2.1 time: 0.075522 Dec 15 13:41:04.989149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 319/647] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:04 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:41:05.960943 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-929791b7-4054-4eff-ad8a-456abbd3d1d6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:05.961992 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-929791b7-4054-4eff-ad8a-456abbd3d1d6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:05.969381 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-929791b7-4054-4eff-ad8a-456abbd3d1d6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:05.969860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-929791b7-4054-4eff-ad8a-456abbd3d1d6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:05.970633 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-929791b7-4054-4eff-ad8a-456abbd3d1d6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:05.971062 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-929791b7-4054-4eff-ad8a-456abbd3d1d6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:05.999918 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cd62ae67-9c01-4db7-a468-7d8933b6db66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:06.000906 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cd62ae67-9c01-4db7-a468-7d8933b6db66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:06.007787 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd62ae67-9c01-4db7-a468-7d8933b6db66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:06.008245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd62ae67-9c01-4db7-a468-7d8933b6db66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:06.008991 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd62ae67-9c01-4db7-a468-7d8933b6db66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:06.009417 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd62ae67-9c01-4db7-a468-7d8933b6db66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:06.055233 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-929791b7-4054-4eff-ad8a-456abbd3d1d6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 25103 microversion: 2.20 time: 0.098441 Dec 15 13:41:06.055886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 329/648] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:05 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 25103 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:06.112958 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cd62ae67-9c01-4db7-a468-7d8933b6db66 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 5108 microversion: 2.1 time: 0.116777 Dec 15 13:41:06.113507 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 320/649] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:05 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 5108 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:07.067373 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5273ccdf-e1c1-4711-a160-605210c94f11 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:07.068281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5273ccdf-e1c1-4711-a160-605210c94f11 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:07.075650 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5273ccdf-e1c1-4711-a160-605210c94f11 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:07.076091 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5273ccdf-e1c1-4711-a160-605210c94f11 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:07.076860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5273ccdf-e1c1-4711-a160-605210c94f11 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:07.077292 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5273ccdf-e1c1-4711-a160-605210c94f11 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:07.124825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-44f77843-521e-4300-b483-620236cf7c6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:07.125871 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-44f77843-521e-4300-b483-620236cf7c6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:07.132595 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44f77843-521e-4300-b483-620236cf7c6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:07.133050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44f77843-521e-4300-b483-620236cf7c6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:07.133850 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44f77843-521e-4300-b483-620236cf7c6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:07.134287 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44f77843-521e-4300-b483-620236cf7c6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:07.165264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5273ccdf-e1c1-4711-a160-605210c94f11 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 26440 microversion: 2.20 time: 0.101842 Dec 15 13:41:07.165941 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 330/650] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:07 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 26440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:07.213991 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-44f77843-521e-4300-b483-620236cf7c6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 13887 microversion: 2.1 time: 0.093404 Dec 15 13:41:07.214634 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 321/651] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:07 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 13887 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:08.177086 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-61a96714-403a-4020-a575-e1d2ce9dd0b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:08.178232 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-61a96714-403a-4020-a575-e1d2ce9dd0b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:08.185557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-61a96714-403a-4020-a575-e1d2ce9dd0b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:08.186022 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-61a96714-403a-4020-a575-e1d2ce9dd0b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:08.186789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-61a96714-403a-4020-a575-e1d2ce9dd0b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:08.187218 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-61a96714-403a-4020-a575-e1d2ce9dd0b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:08.225714 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2416f330-8f94-4dc1-913d-780d498c0c20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:08.226743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2416f330-8f94-4dc1-913d-780d498c0c20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:08.233641 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2416f330-8f94-4dc1-913d-780d498c0c20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:08.234121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2416f330-8f94-4dc1-913d-780d498c0c20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:08.234897 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2416f330-8f94-4dc1-913d-780d498c0c20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:08.235338 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2416f330-8f94-4dc1-913d-780d498c0c20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:08.266484 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-61a96714-403a-4020-a575-e1d2ce9dd0b4 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 27381 microversion: 2.20 time: 0.093314 Dec 15 13:41:08.267152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 331/652] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:08 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 27381 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:41:08.327066 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2416f330-8f94-4dc1-913d-780d498c0c20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 18356 microversion: 2.1 time: 0.105444 Dec 15 13:41:08.327682 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 322/653] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:08 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 18356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:09.279562 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-65f4fdb0-5a32-4755-a9dd-7a54ec47f087 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:09.280915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-65f4fdb0-5a32-4755-a9dd-7a54ec47f087 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:09.288376 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-65f4fdb0-5a32-4755-a9dd-7a54ec47f087 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.288820 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-65f4fdb0-5a32-4755-a9dd-7a54ec47f087 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.289616 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-65f4fdb0-5a32-4755-a9dd-7a54ec47f087 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.290076 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-65f4fdb0-5a32-4755-a9dd-7a54ec47f087 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.339773 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d68b26a8-2dd6-4a69-a5c5-ce0e47793ce6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:09.341250 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d68b26a8-2dd6-4a69-a5c5-ce0e47793ce6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:09.348300 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d68b26a8-2dd6-4a69-a5c5-ce0e47793ce6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.348731 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d68b26a8-2dd6-4a69-a5c5-ce0e47793ce6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.349507 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d68b26a8-2dd6-4a69-a5c5-ce0e47793ce6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.349968 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d68b26a8-2dd6-4a69-a5c5-ce0e47793ce6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.372451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-65f4fdb0-5a32-4755-a9dd-7a54ec47f087 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 27806 microversion: 2.20 time: 0.097430 Dec 15 13:41:09.376377 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 332/654] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:09 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 27806 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:09.433266 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d68b26a8-2dd6-4a69-a5c5-ce0e47793ce6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 19133 microversion: 2.1 time: 0.097367 Dec 15 13:41:09.434257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 323/655] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:09 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 19133 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:09.711085 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5e40e530-1090-4373-9602-fccd1fb33758 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:09.712080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5e40e530-1090-4373-9602-fccd1fb33758 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:09.719581 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5e40e530-1090-4373-9602-fccd1fb33758 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.720025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5e40e530-1090-4373-9602-fccd1fb33758 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.720812 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5e40e530-1090-4373-9602-fccd1fb33758 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.721247 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5e40e530-1090-4373-9602-fccd1fb33758 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.792422 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5e40e530-1090-4373-9602-fccd1fb33758 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "POST /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/action" status: 202 len: 0 microversion: 2.1 time: 0.085516 Dec 15 13:41:09.793197 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 333/656] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:09 2021] POST /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:09.801694 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-fe2a51c2-c383-4e90-a400-214029085d25 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:09.802424 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-fe2a51c2-c383-4e90-a400-214029085d25 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:09.810198 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe2a51c2-c383-4e90-a400-214029085d25 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.810680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe2a51c2-c383-4e90-a400-214029085d25 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:09.811607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe2a51c2-c383-4e90-a400-214029085d25 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:09.812128 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe2a51c2-c383-4e90-a400-214029085d25 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:10.055889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-fe2a51c2-c383-4e90-a400-214029085d25 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:10.064251 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-fe2a51c2-c383-4e90-a400-214029085d25 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1749 microversion: 2.1 time: 0.266786 Dec 15 13:41:10.064828 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 324/657] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:09 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1749 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:10.385092 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-86c2af59-8862-4850-a1b3-b6efef68878b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:10.386098 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-86c2af59-8862-4850-a1b3-b6efef68878b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:10.391978 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-86c2af59-8862-4850-a1b3-b6efef68878b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:10.392447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-86c2af59-8862-4850-a1b3-b6efef68878b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:10.393181 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-86c2af59-8862-4850-a1b3-b6efef68878b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:10.393603 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-86c2af59-8862-4850-a1b3-b6efef68878b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:10.444542 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-271c4a9f-c58f-4dfa-a676-535b7eb713a0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:10.445290 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-271c4a9f-c58f-4dfa-a676-535b7eb713a0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:10.451586 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-271c4a9f-c58f-4dfa-a676-535b7eb713a0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:10.452028 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-271c4a9f-c58f-4dfa-a676-535b7eb713a0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:10.452798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-271c4a9f-c58f-4dfa-a676-535b7eb713a0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:10.453257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-271c4a9f-c58f-4dfa-a676-535b7eb713a0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:10.474939 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-86c2af59-8862-4850-a1b3-b6efef68878b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 28225 microversion: 2.20 time: 0.094341 Dec 15 13:41:10.475517 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 334/658] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:10 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 28225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:10.544051 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-271c4a9f-c58f-4dfa-a676-535b7eb713a0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 21518 microversion: 2.1 time: 0.102630 Dec 15 13:41:10.544687 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 325/659] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:10 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 21518 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:11.082893 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4c1bf344-5769-4170-b6ef-40c443ac0828 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:11.083587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4c1bf344-5769-4170-b6ef-40c443ac0828 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:11.091114 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4c1bf344-5769-4170-b6ef-40c443ac0828 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:11.091556 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4c1bf344-5769-4170-b6ef-40c443ac0828 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:11.092327 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4c1bf344-5769-4170-b6ef-40c443ac0828 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:11.092757 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4c1bf344-5769-4170-b6ef-40c443ac0828 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:11.241129 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4c1bf344-5769-4170-b6ef-40c443ac0828 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:11.249027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4c1bf344-5769-4170-b6ef-40c443ac0828 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.170149 Dec 15 13:41:11.249624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 335/660] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:11 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:11.487159 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-768c397e-a7b8-4188-b160-3b03e0339e73 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:11.488138 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-768c397e-a7b8-4188-b160-3b03e0339e73 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:11.495372 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-768c397e-a7b8-4188-b160-3b03e0339e73 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:11.495817 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-768c397e-a7b8-4188-b160-3b03e0339e73 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:11.497090 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-768c397e-a7b8-4188-b160-3b03e0339e73 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:11.497520 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-768c397e-a7b8-4188-b160-3b03e0339e73 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:11.555268 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-719ca377-f172-4bb9-9f39-0dce4250f5e5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:11.556230 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-719ca377-f172-4bb9-9f39-0dce4250f5e5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:11.563821 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-719ca377-f172-4bb9-9f39-0dce4250f5e5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:11.564331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-719ca377-f172-4bb9-9f39-0dce4250f5e5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:11.565269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-719ca377-f172-4bb9-9f39-0dce4250f5e5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:11.565705 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-719ca377-f172-4bb9-9f39-0dce4250f5e5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:11.567587 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-768c397e-a7b8-4188-b160-3b03e0339e73 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 28225 microversion: 2.20 time: 0.084267 Dec 15 13:41:11.571564 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 326/661] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:11 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 28225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:11.641917 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-719ca377-f172-4bb9-9f39-0dce4250f5e5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 22980 microversion: 2.1 time: 0.090038 Dec 15 13:41:11.642782 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 336/662] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:11 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 22980 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:12.267545 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e246afb4-ddd8-4cfa-9f83-fe3f646eb5cf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:12.268172 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e246afb4-ddd8-4cfa-9f83-fe3f646eb5cf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:12.274993 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e246afb4-ddd8-4cfa-9f83-fe3f646eb5cf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.275486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e246afb4-ddd8-4cfa-9f83-fe3f646eb5cf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:12.276258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e246afb4-ddd8-4cfa-9f83-fe3f646eb5cf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.276692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e246afb4-ddd8-4cfa-9f83-fe3f646eb5cf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:12.430815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e246afb4-ddd8-4cfa-9f83-fe3f646eb5cf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:12.438745 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e246afb4-ddd8-4cfa-9f83-fe3f646eb5cf tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.175355 Dec 15 13:41:12.439311 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 327/663] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:12 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:12.580134 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ed450c64-c8a2-41ff-b59b-14690d247e22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:12.581047 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ed450c64-c8a2-41ff-b59b-14690d247e22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:12.588563 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed450c64-c8a2-41ff-b59b-14690d247e22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.589003 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed450c64-c8a2-41ff-b59b-14690d247e22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:12.589810 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed450c64-c8a2-41ff-b59b-14690d247e22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.590737 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ed450c64-c8a2-41ff-b59b-14690d247e22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:12.653790 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-856e4a5c-1449-4e96-8cc2-62abe067f5f0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:12.654761 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-856e4a5c-1449-4e96-8cc2-62abe067f5f0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:12.661055 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-856e4a5c-1449-4e96-8cc2-62abe067f5f0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.661504 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-856e4a5c-1449-4e96-8cc2-62abe067f5f0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:12.662312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-856e4a5c-1449-4e96-8cc2-62abe067f5f0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:12.662743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-856e4a5c-1449-4e96-8cc2-62abe067f5f0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:12.673425 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ed450c64-c8a2-41ff-b59b-14690d247e22 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 28421 microversion: 2.20 time: 0.097293 Dec 15 13:41:12.674759 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 337/664] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:12 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 28421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:12.752540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-856e4a5c-1449-4e96-8cc2-62abe067f5f0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 23901 microversion: 2.1 time: 0.102896 Dec 15 13:41:12.753169 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 328/665] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:12 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 23901 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:13.457180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-76e90bcd-9ec0-435c-ab87-9ddab9aa4e14 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:13.457904 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-76e90bcd-9ec0-435c-ab87-9ddab9aa4e14 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:13.465136 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-76e90bcd-9ec0-435c-ab87-9ddab9aa4e14 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:13.465587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-76e90bcd-9ec0-435c-ab87-9ddab9aa4e14 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:13.466405 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-76e90bcd-9ec0-435c-ab87-9ddab9aa4e14 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:13.466845 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-76e90bcd-9ec0-435c-ab87-9ddab9aa4e14 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:13.633491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-76e90bcd-9ec0-435c-ab87-9ddab9aa4e14 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:13.645451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-76e90bcd-9ec0-435c-ab87-9ddab9aa4e14 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.192379 Dec 15 13:41:13.646049 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 338/666] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:13 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:13.686988 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-81ad4e09-e816-4ee9-b1e7-acd3d2dfcff0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:13.687982 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-81ad4e09-e816-4ee9-b1e7-acd3d2dfcff0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:13.695061 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81ad4e09-e816-4ee9-b1e7-acd3d2dfcff0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:13.695507 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81ad4e09-e816-4ee9-b1e7-acd3d2dfcff0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:13.696295 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81ad4e09-e816-4ee9-b1e7-acd3d2dfcff0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:13.696726 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81ad4e09-e816-4ee9-b1e7-acd3d2dfcff0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:13.763786 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-26f5a265-514f-48df-8cbf-3ae4ae0aaa88 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:13.764596 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-26f5a265-514f-48df-8cbf-3ae4ae0aaa88 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:13.770960 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26f5a265-514f-48df-8cbf-3ae4ae0aaa88 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:13.771398 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26f5a265-514f-48df-8cbf-3ae4ae0aaa88 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:13.772168 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26f5a265-514f-48df-8cbf-3ae4ae0aaa88 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:13.772593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26f5a265-514f-48df-8cbf-3ae4ae0aaa88 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:13.797920 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-81ad4e09-e816-4ee9-b1e7-acd3d2dfcff0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 28551 microversion: 2.20 time: 0.115406 Dec 15 13:41:13.798563 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 329/667] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:13 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 28551 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:13.849729 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-26f5a265-514f-48df-8cbf-3ae4ae0aaa88 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 25545 microversion: 2.1 time: 0.089513 Dec 15 13:41:13.850431 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 339/668] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:13 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 25545 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:14.663201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-24091f18-8cc1-4f4b-a60c-8a3fff10e0d2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:14.663893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-24091f18-8cc1-4f4b-a60c-8a3fff10e0d2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:14.670666 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-24091f18-8cc1-4f4b-a60c-8a3fff10e0d2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:14.671112 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-24091f18-8cc1-4f4b-a60c-8a3fff10e0d2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:14.671909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-24091f18-8cc1-4f4b-a60c-8a3fff10e0d2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:14.672340 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-24091f18-8cc1-4f4b-a60c-8a3fff10e0d2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:14.811180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-149f63ce-bb9b-4bc1-bf42-5130f1217491 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:14.812656 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-149f63ce-bb9b-4bc1-bf42-5130f1217491 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:14.818848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-24091f18-8cc1-4f4b-a60c-8a3fff10e0d2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:14.820603 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-149f63ce-bb9b-4bc1-bf42-5130f1217491 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:14.821045 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-149f63ce-bb9b-4bc1-bf42-5130f1217491 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:14.821918 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-149f63ce-bb9b-4bc1-bf42-5130f1217491 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:14.822350 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-149f63ce-bb9b-4bc1-bf42-5130f1217491 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:14.827306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-24091f18-8cc1-4f4b-a60c-8a3fff10e0d2 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.168125 Dec 15 13:41:14.827875 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 330/669] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:14 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:14.860904 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-fe9feb8e-5582-4382-9d7e-718dfaa6244d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:14.861840 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-fe9feb8e-5582-4382-9d7e-718dfaa6244d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:14.867603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe9feb8e-5582-4382-9d7e-718dfaa6244d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:14.868048 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe9feb8e-5582-4382-9d7e-718dfaa6244d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:14.868820 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe9feb8e-5582-4382-9d7e-718dfaa6244d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:14.869254 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe9feb8e-5582-4382-9d7e-718dfaa6244d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:14.898658 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-149f63ce-bb9b-4bc1-bf42-5130f1217491 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 28684 microversion: 2.20 time: 0.092241 Dec 15 13:41:14.899344 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 340/670] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:14 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 28684 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:41:14.948861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-fe9feb8e-5582-4382-9d7e-718dfaa6244d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 26828 microversion: 2.1 time: 0.091332 Dec 15 13:41:14.949511 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 331/671] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:14 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 26828 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:15.845007 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-56c960c8-0b05-42da-b8dd-23b25ab81ec4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:15.845884 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-56c960c8-0b05-42da-b8dd-23b25ab81ec4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:15.853203 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-56c960c8-0b05-42da-b8dd-23b25ab81ec4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:15.853657 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-56c960c8-0b05-42da-b8dd-23b25ab81ec4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:15.854520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-56c960c8-0b05-42da-b8dd-23b25ab81ec4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:15.854983 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-56c960c8-0b05-42da-b8dd-23b25ab81ec4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:15.910747 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7c469be9-69ff-48fe-8452-1d7a91b53fd7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:15.911679 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7c469be9-69ff-48fe-8452-1d7a91b53fd7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:15.919070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7c469be9-69ff-48fe-8452-1d7a91b53fd7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:15.919532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7c469be9-69ff-48fe-8452-1d7a91b53fd7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:15.920394 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7c469be9-69ff-48fe-8452-1d7a91b53fd7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:15.920821 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7c469be9-69ff-48fe-8452-1d7a91b53fd7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:15.994027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7c469be9-69ff-48fe-8452-1d7a91b53fd7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 28684 microversion: 2.20 time: 0.087253 Dec 15 13:41:15.998608 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 332/672] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:15 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 28684 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:41:16.001286 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a7502cb8-58d2-48e3-9680-6a3f2f42f409 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:16.002313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a7502cb8-58d2-48e3-9680-6a3f2f42f409 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:16.006117 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-56c960c8-0b05-42da-b8dd-23b25ab81ec4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:16.008845 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7502cb8-58d2-48e3-9680-6a3f2f42f409 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:16.009305 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7502cb8-58d2-48e3-9680-6a3f2f42f409 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:16.010142 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7502cb8-58d2-48e3-9680-6a3f2f42f409 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:16.010590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a7502cb8-58d2-48e3-9680-6a3f2f42f409 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:16.013911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-56c960c8-0b05-42da-b8dd-23b25ab81ec4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.173342 Dec 15 13:41:16.014479 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 341/673] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:15 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:16.092464 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a7502cb8-58d2-48e3-9680-6a3f2f42f409 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 27465 microversion: 2.1 time: 0.096105 Dec 15 13:41:16.093095 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 333/674] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:15 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 27465 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:17.006347 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0484bd76-dfe7-4118-a33f-acc219743e7f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:17.007170 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0484bd76-dfe7-4118-a33f-acc219743e7f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:17.013467 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0484bd76-dfe7-4118-a33f-acc219743e7f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:17.013935 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0484bd76-dfe7-4118-a33f-acc219743e7f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:17.014708 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0484bd76-dfe7-4118-a33f-acc219743e7f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:17.015135 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0484bd76-dfe7-4118-a33f-acc219743e7f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:17.031659 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ad00f8a9-8801-45c9-b08b-36ae9b8e22bd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:17.032342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ad00f8a9-8801-45c9-b08b-36ae9b8e22bd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:17.039291 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ad00f8a9-8801-45c9-b08b-36ae9b8e22bd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:17.039739 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ad00f8a9-8801-45c9-b08b-36ae9b8e22bd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:17.040513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ad00f8a9-8801-45c9-b08b-36ae9b8e22bd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:17.040940 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ad00f8a9-8801-45c9-b08b-36ae9b8e22bd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:17.082967 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0484bd76-dfe7-4118-a33f-acc219743e7f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 28684 microversion: 2.20 time: 0.080161 Dec 15 13:41:17.083628 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 342/675] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:17 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 28684 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:17.103661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4260461b-7e1a-4cd1-8cbe-f110968bc69a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:17.104640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4260461b-7e1a-4cd1-8cbe-f110968bc69a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:17.111925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4260461b-7e1a-4cd1-8cbe-f110968bc69a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:17.112375 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4260461b-7e1a-4cd1-8cbe-f110968bc69a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:17.113136 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4260461b-7e1a-4cd1-8cbe-f110968bc69a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:17.113557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4260461b-7e1a-4cd1-8cbe-f110968bc69a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:17.193111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4260461b-7e1a-4cd1-8cbe-f110968bc69a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 27890 microversion: 2.1 time: 0.093115 Dec 15 13:41:17.194661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 343/676] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:17 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 27890 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:17.197102 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ad00f8a9-8801-45c9-b08b-36ae9b8e22bd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:17.205329 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ad00f8a9-8801-45c9-b08b-36ae9b8e22bd tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.178697 Dec 15 13:41:17.205917 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 334/677] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:17 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:18.096075 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7141d79b-0cc3-499f-a8e5-7fa55cb65fc9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:18.097150 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7141d79b-0cc3-499f-a8e5-7fa55cb65fc9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:18.103942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7141d79b-0cc3-499f-a8e5-7fa55cb65fc9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:18.104393 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7141d79b-0cc3-499f-a8e5-7fa55cb65fc9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:18.105169 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7141d79b-0cc3-499f-a8e5-7fa55cb65fc9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:18.105617 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7141d79b-0cc3-499f-a8e5-7fa55cb65fc9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:18.182045 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7141d79b-0cc3-499f-a8e5-7fa55cb65fc9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 28830 microversion: 2.20 time: 0.089814 Dec 15 13:41:18.182678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 344/678] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:18 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 28830 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:18.204696 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b5333a56-fad5-4c2e-bda7-17a73ad6daab tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:18.205627 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b5333a56-fad5-4c2e-bda7-17a73ad6daab tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:18.212089 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b5333a56-fad5-4c2e-bda7-17a73ad6daab tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:18.212529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b5333a56-fad5-4c2e-bda7-17a73ad6daab tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:18.213330 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b5333a56-fad5-4c2e-bda7-17a73ad6daab tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:18.213778 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b5333a56-fad5-4c2e-bda7-17a73ad6daab tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:18.223355 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7d4704e4-155b-4290-b1f3-e2ae16a65551 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:18.224163 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7d4704e4-155b-4290-b1f3-e2ae16a65551 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:18.230824 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d4704e4-155b-4290-b1f3-e2ae16a65551 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:18.231266 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d4704e4-155b-4290-b1f3-e2ae16a65551 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:18.232030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d4704e4-155b-4290-b1f3-e2ae16a65551 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:18.232461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d4704e4-155b-4290-b1f3-e2ae16a65551 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:18.292972 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b5333a56-fad5-4c2e-bda7-17a73ad6daab tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28201 microversion: 2.1 time: 0.091545 Dec 15 13:41:18.293507 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 335/679] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:18 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:18.382533 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7d4704e4-155b-4290-b1f3-e2ae16a65551 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:18.390858 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7d4704e4-155b-4290-b1f3-e2ae16a65551 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.171367 Dec 15 13:41:18.391415 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 345/680] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:18 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:19.086425 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a5e5b25c-1137-43d7-a99e-849e6c49df0e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:19.086910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a5e5b25c-1137-43d7-a99e-849e6c49df0e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:19.094356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a5e5b25c-1137-43d7-a99e-849e6c49df0e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.094804 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a5e5b25c-1137-43d7-a99e-849e6c49df0e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.095589 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a5e5b25c-1137-43d7-a99e-849e6c49df0e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.096021 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a5e5b25c-1137-43d7-a99e-849e6c49df0e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.121461 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a5e5b25c-1137-43d7-a99e-849e6c49df0e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:41:19.195344 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ceeedff7-9485-4840-9208-dda239398cd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:19.196404 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ceeedff7-9485-4840-9208-dda239398cd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:19.201949 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a5e5b25c-1137-43d7-a99e-849e6c49df0e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 204 len: 0 microversion: 2.1 time: 0.119530 Dec 15 13:41:19.203187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ceeedff7-9485-4840-9208-dda239398cd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.203373 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 336/681] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:41:19 2021] DELETE /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:41:19.203895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ceeedff7-9485-4840-9208-dda239398cd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.204746 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ceeedff7-9485-4840-9208-dda239398cd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.205245 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ceeedff7-9485-4840-9208-dda239398cd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.213304 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-19e8bfb1-474b-4d42-a85c-de037d2e7e9d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:19.214095 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-19e8bfb1-474b-4d42-a85c-de037d2e7e9d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:19.220889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19e8bfb1-474b-4d42-a85c-de037d2e7e9d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.221331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19e8bfb1-474b-4d42-a85c-de037d2e7e9d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.222158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19e8bfb1-474b-4d42-a85c-de037d2e7e9d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.222618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19e8bfb1-474b-4d42-a85c-de037d2e7e9d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.304591 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ceeedff7-9485-4840-9208-dda239398cd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 30632 microversion: 2.20 time: 0.113892 Dec 15 13:41:19.308691 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 346/682] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:19 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 30632 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:41:19.310513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8121b26f-7a4c-46c9-9c10-688ae9def673 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:19.311535 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8121b26f-7a4c-46c9-9c10-688ae9def673 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:19.318931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8121b26f-7a4c-46c9-9c10-688ae9def673 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.319193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8121b26f-7a4c-46c9-9c10-688ae9def673 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.320623 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8121b26f-7a4c-46c9-9c10-688ae9def673 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.320623 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8121b26f-7a4c-46c9-9c10-688ae9def673 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.378102 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-19e8bfb1-474b-4d42-a85c-de037d2e7e9d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:19.386532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-19e8bfb1-474b-4d42-a85c-de037d2e7e9d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1577 microversion: 2.1 time: 0.178270 Dec 15 13:41:19.387663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 337/683] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:19 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:19.401573 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8121b26f-7a4c-46c9-9c10-688ae9def673 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28201 microversion: 2.1 time: 0.094770 Dec 15 13:41:19.402453 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 347/684] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:19 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:19.408266 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6e5a194c-2b82-4f3d-8f11-3a9749c89a64 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:19.408872 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6e5a194c-2b82-4f3d-8f11-3a9749c89a64 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:19.415199 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6e5a194c-2b82-4f3d-8f11-3a9749c89a64 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.415783 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6e5a194c-2b82-4f3d-8f11-3a9749c89a64 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.417337 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6e5a194c-2b82-4f3d-8f11-3a9749c89a64 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:19.417337 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6e5a194c-2b82-4f3d-8f11-3a9749c89a64 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:19.561873 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6e5a194c-2b82-4f3d-8f11-3a9749c89a64 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:19.569948 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6e5a194c-2b82-4f3d-8f11-3a9749c89a64 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.165179 Dec 15 13:41:19.570519 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 338/685] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:19 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:20.317138 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5e01e5b5-0fa4-4163-ac5d-55def330a832 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:20.318070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5e01e5b5-0fa4-4163-ac5d-55def330a832 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:20.325965 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5e01e5b5-0fa4-4163-ac5d-55def330a832 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:20.326408 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5e01e5b5-0fa4-4163-ac5d-55def330a832 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:20.327234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5e01e5b5-0fa4-4163-ac5d-55def330a832 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:20.327657 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5e01e5b5-0fa4-4163-ac5d-55def330a832 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:20.404856 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8a872df8-cb59-47d8-9418-0f0400d7b31b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:20.405535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8a872df8-cb59-47d8-9418-0f0400d7b31b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:20.412257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8a872df8-cb59-47d8-9418-0f0400d7b31b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:20.412693 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8a872df8-cb59-47d8-9418-0f0400d7b31b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:20.413482 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8a872df8-cb59-47d8-9418-0f0400d7b31b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:20.413951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8a872df8-cb59-47d8-9418-0f0400d7b31b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:20.422417 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5e01e5b5-0fa4-4163-ac5d-55def330a832 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 32085 microversion: 2.20 time: 0.109193 Dec 15 13:41:20.426588 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 348/686] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:20 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 32085 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:20.428763 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-bb9bd5cc-f500-428d-937d-c30dc5203d31 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:20.429794 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-bb9bd5cc-f500-428d-937d-c30dc5203d31 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:20.437546 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb9bd5cc-f500-428d-937d-c30dc5203d31 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:20.438035 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb9bd5cc-f500-428d-937d-c30dc5203d31 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:20.438831 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb9bd5cc-f500-428d-937d-c30dc5203d31 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:20.439266 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb9bd5cc-f500-428d-937d-c30dc5203d31 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:20.529131 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-bb9bd5cc-f500-428d-937d-c30dc5203d31 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28441 microversion: 2.1 time: 0.103950 Dec 15 13:41:20.530104 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 349/687] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:20 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28441 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:20.564600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8a872df8-cb59-47d8-9418-0f0400d7b31b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:20.572236 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8a872df8-cb59-47d8-9418-0f0400d7b31b tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1577 microversion: 2.1 time: 0.171525 Dec 15 13:41:20.572732 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 339/688] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:20 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:20.587930 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-bb84c0b2-c135-48cb-8f02-f241d950169e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:20.588741 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-bb84c0b2-c135-48cb-8f02-f241d950169e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:20.595921 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb84c0b2-c135-48cb-8f02-f241d950169e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:20.596373 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb84c0b2-c135-48cb-8f02-f241d950169e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:20.597148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb84c0b2-c135-48cb-8f02-f241d950169e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:20.597584 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bb84c0b2-c135-48cb-8f02-f241d950169e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:20.745407 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-bb84c0b2-c135-48cb-8f02-f241d950169e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:20.754386 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-bb84c0b2-c135-48cb-8f02-f241d950169e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1754 microversion: 2.1 time: 0.170889 Dec 15 13:41:20.754953 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 350/689] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:20 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:21.434493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b221cf6a-1785-4ca9-91b2-7fe457ad21dd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:21.435600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b221cf6a-1785-4ca9-91b2-7fe457ad21dd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:21.442114 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b221cf6a-1785-4ca9-91b2-7fe457ad21dd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:21.442655 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b221cf6a-1785-4ca9-91b2-7fe457ad21dd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:21.443433 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b221cf6a-1785-4ca9-91b2-7fe457ad21dd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:21.443892 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b221cf6a-1785-4ca9-91b2-7fe457ad21dd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:21.525495 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b221cf6a-1785-4ca9-91b2-7fe457ad21dd tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 33191 microversion: 2.20 time: 0.094673 Dec 15 13:41:21.530152 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 340/690] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:21 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 33191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:21.541081 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4b5c244e-9dd6-4978-ae3b-114da49c1c64 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:21.541948 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4b5c244e-9dd6-4978-ae3b-114da49c1c64 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:21.548712 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4b5c244e-9dd6-4978-ae3b-114da49c1c64 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:21.549152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4b5c244e-9dd6-4978-ae3b-114da49c1c64 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:21.549962 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4b5c244e-9dd6-4978-ae3b-114da49c1c64 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:21.550395 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4b5c244e-9dd6-4978-ae3b-114da49c1c64 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:21.590908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b4f81a7c-0fb6-41ac-9a6f-5822ad110b3d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:21.591648 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b4f81a7c-0fb6-41ac-9a6f-5822ad110b3d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:21.598446 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4f81a7c-0fb6-41ac-9a6f-5822ad110b3d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:21.598899 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4f81a7c-0fb6-41ac-9a6f-5822ad110b3d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:21.599713 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4f81a7c-0fb6-41ac-9a6f-5822ad110b3d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:21.600150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4f81a7c-0fb6-41ac-9a6f-5822ad110b3d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:21.632857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4b5c244e-9dd6-4978-ae3b-114da49c1c64 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28490 microversion: 2.1 time: 0.095094 Dec 15 13:41:21.634108 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 351/691] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:21 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28490 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:21.771952 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5c8a5766-7fd4-41cc-af52-8970075d5fd4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:21.772744 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5c8a5766-7fd4-41cc-af52-8970075d5fd4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:21.780325 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5c8a5766-7fd4-41cc-af52-8970075d5fd4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:21.780778 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5c8a5766-7fd4-41cc-af52-8970075d5fd4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:21.781569 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5c8a5766-7fd4-41cc-af52-8970075d5fd4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:21.782024 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5c8a5766-7fd4-41cc-af52-8970075d5fd4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:21.799894 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b4f81a7c-0fb6-41ac-9a6f-5822ad110b3d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:21.807387 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b4f81a7c-0fb6-41ac-9a6f-5822ad110b3d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1577 microversion: 2.1 time: 0.221068 Dec 15 13:41:21.817029 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 341/692] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:21 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:22.057822 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5c8a5766-7fd4-41cc-af52-8970075d5fd4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:22.065927 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5c8a5766-7fd4-41cc-af52-8970075d5fd4 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1757 microversion: 2.1 time: 0.297979 Dec 15 13:41:22.066806 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 352/693] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:21 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1757 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:22.258020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-5f488947-ddc3-4f97-b3db-98f72d79c0dd req-519d1b07-8446-43b0-a5d2-c5c0f2053837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa99337-9b29-41bc-90eb-cf4ffdbc2a44", "name": "network-vif-deleted", "tag": "0387f3fb-6863-45ce-b5d6-5a1b21700b4b"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:22.259677 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:41:22.259677 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:41:22.269264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-5f488947-ddc3-4f97-b3db-98f72d79c0dd req-519d1b07-8446-43b0-a5d2-c5c0f2053837 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:22.269708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-5f488947-ddc3-4f97-b3db-98f72d79c0dd req-519d1b07-8446-43b0-a5d2-c5c0f2053837 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:22.284854 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-5f488947-ddc3-4f97-b3db-98f72d79c0dd req-519d1b07-8446-43b0-a5d2-c5c0f2053837 service nova] Creating event network-vif-deleted:0387f3fb-6863-45ce-b5d6-5a1b21700b4b for instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 on hv-cinder-81322 Dec 15 13:41:22.290879 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-5f488947-ddc3-4f97-b3db-98f72d79c0dd req-519d1b07-8446-43b0-a5d2-c5c0f2053837 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036345 Dec 15 13:41:22.295010 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 342/694] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:41:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:22.537988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-639c4304-fcde-41dd-9b90-c97aa01caba8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:22.538915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-639c4304-fcde-41dd-9b90-c97aa01caba8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:22.545921 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-639c4304-fcde-41dd-9b90-c97aa01caba8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:22.547030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-639c4304-fcde-41dd-9b90-c97aa01caba8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:22.547817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-639c4304-fcde-41dd-9b90-c97aa01caba8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:22.548253 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-639c4304-fcde-41dd-9b90-c97aa01caba8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:22.645258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-111d889f-77cc-4a4e-ad4a-15394009b6b0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:22.646644 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-111d889f-77cc-4a4e-ad4a-15394009b6b0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:22.653935 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-639c4304-fcde-41dd-9b90-c97aa01caba8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 34077 microversion: 2.20 time: 0.118847 Dec 15 13:41:22.659247 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-111d889f-77cc-4a4e-ad4a-15394009b6b0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:22.659632 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 353/695] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:22 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 34077 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:22.659755 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-111d889f-77cc-4a4e-ad4a-15394009b6b0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:22.660515 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-111d889f-77cc-4a4e-ad4a-15394009b6b0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:22.660943 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-111d889f-77cc-4a4e-ad4a-15394009b6b0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:22.750349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-111d889f-77cc-4a4e-ad4a-15394009b6b0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28658 microversion: 2.1 time: 0.108529 Dec 15 13:41:22.754735 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 343/696] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:22 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28658 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:22.825665 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:22.826378 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:22.833743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:22.834221 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:22.835274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:22.835709 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:22.870895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:22.871948 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:22.872548 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lazy-loading 'fault' on Instance uuid 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:41:23.141690 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:23.149063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5f8b3a62-d290-4853-873b-15be1591c6e8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 200 len: 1183 microversion: 2.1 time: 0.327941 Dec 15 13:41:23.149674 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 354/697] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:22 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 1183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:23.667113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-85065edf-68e5-46ee-94a4-322cb6627db6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:23.668093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-85065edf-68e5-46ee-94a4-322cb6627db6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:23.674852 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85065edf-68e5-46ee-94a4-322cb6627db6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:23.675295 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85065edf-68e5-46ee-94a4-322cb6627db6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:23.676059 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85065edf-68e5-46ee-94a4-322cb6627db6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:23.676486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85065edf-68e5-46ee-94a4-322cb6627db6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:23.750130 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-85065edf-68e5-46ee-94a4-322cb6627db6 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 35005 microversion: 2.20 time: 0.086907 Dec 15 13:41:23.750751 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 344/698] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:23 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 35005 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:23.762081 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b5c96af6-f3e0-4057-a00e-a79f4531c59f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:23.763607 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b5c96af6-f3e0-4057-a00e-a79f4531c59f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:23.770015 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b5c96af6-f3e0-4057-a00e-a79f4531c59f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:23.770461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b5c96af6-f3e0-4057-a00e-a79f4531c59f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:23.771231 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b5c96af6-f3e0-4057-a00e-a79f4531c59f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:23.771672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b5c96af6-f3e0-4057-a00e-a79f4531c59f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:23.836723 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b5c96af6-f3e0-4057-a00e-a79f4531c59f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28658 microversion: 2.1 time: 0.078086 Dec 15 13:41:23.837328 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 355/699] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:23 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28658 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:24.166519 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:24.167203 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:24.174485 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:24.174933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:24.175702 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:24.176133 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:24.190203 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] HTTP exception thrown: Instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 could not be found. Dec 15 13:41:24.190782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Returning 404 to user: Instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:41:24.191589 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-44f750d8-8b7f-4a85-9c9a-cae2bcc064d3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 404 len: 111 microversion: 2.1 time: 0.029188 Dec 15 13:41:24.192107 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 345/700] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:24 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:41:24.283698 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1697524485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2022049678", "security_groups": [{"name": "tempest-secgroup-smoke-1219894246"}], "block_device_mapping_v2": [{"uuid": "ff364c49-b661-4450-8f98-839e2a3515e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7bf9178e-ef91-4e23-a896-35ca60172592"}]}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:24.391033 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.network.neutron [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] validate_networks() for [('7bf9178e-ef91-4e23-a896-35ca60172592', None, None, None, None, None)] {{(pid=122611) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:41:24.750641 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Flavor limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:41:24.751001 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Image limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:41:24.751533 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Flavor pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:41:24.751995 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Image pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:41:24.752406 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:41:24.761007 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:24.761397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-07d3ce17-734e-4039-8a17-82c002c0e1e3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:24.761893 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:24.762769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:24.763235 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-07d3ce17-734e-4039-8a17-82c002c0e1e3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:24.763329 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:24.769093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-07d3ce17-734e-4039-8a17-82c002c0e1e3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:24.769435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-07d3ce17-734e-4039-8a17-82c002c0e1e3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:24.770188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-07d3ce17-734e-4039-8a17-82c002c0e1e3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:24.770613 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-07d3ce17-734e-4039-8a17-82c002c0e1e3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:24.780909 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for project c0da9050a08e442887ca8dc346374836. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:41:24.784952 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for user 7e3a3afdfc4c44a29d0f3df50a5ed2ac and project c0da9050a08e442887ca8dc346374836. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:41:24.844738 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Going to run 1 instances... {{(pid=122611) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:41:24.847851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff364c49-b661-4450-8f98-839e2a3515e0',volume_size=None,volume_type=None)] {{(pid=122611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:41:24.849942 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-07d3ce17-734e-4039-8a17-82c002c0e1e3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 36143 microversion: 2.20 time: 0.091944 Dec 15 13:41:24.854225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 346/701] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:24 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 36143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:41:24.855897 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4f968a67-fa41-4809-a75d-7883b5dbb82f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:24.857073 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4f968a67-fa41-4809-a75d-7883b5dbb82f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:24.863801 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4f968a67-fa41-4809-a75d-7883b5dbb82f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:24.864531 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4f968a67-fa41-4809-a75d-7883b5dbb82f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:24.865323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4f968a67-fa41-4809-a75d-7883b5dbb82f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:24.865770 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4f968a67-fa41-4809-a75d-7883b5dbb82f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:24.933475 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4f968a67-fa41-4809-a75d-7883b5dbb82f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28658 microversion: 2.1 time: 0.081558 Dec 15 13:41:24.934346 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 347/702] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:24 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28658 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:24.977733 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f7576324-945e-40c0-aa97-3b74d904af71 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.697921 Dec 15 13:41:24.978402 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 356/703] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:41:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:41:24.990661 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a5c81642-0e8c-4383-910b-e327e5a2dc00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:24.991346 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a5c81642-0e8c-4383-910b-e327e5a2dc00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:25.051086 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a5c81642-0e8c-4383-910b-e327e5a2dc00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:25.057470 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a5c81642-0e8c-4383-910b-e327e5a2dc00 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1095 microversion: 2.1 time: 0.070779 Dec 15 13:41:25.058048 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 348/704] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:24 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:25.861981 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d81fd0da-51ac-4a93-adc1-530939a016e5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:25.862991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d81fd0da-51ac-4a93-adc1-530939a016e5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:25.871366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d81fd0da-51ac-4a93-adc1-530939a016e5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.872948 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d81fd0da-51ac-4a93-adc1-530939a016e5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.873514 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d81fd0da-51ac-4a93-adc1-530939a016e5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.874561 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d81fd0da-51ac-4a93-adc1-530939a016e5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.944866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5bc132e1-21a6-43d0-9ccb-5cb7510156ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:25.945744 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5bc132e1-21a6-43d0-9ccb-5cb7510156ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:25.953162 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5bc132e1-21a6-43d0-9ccb-5cb7510156ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.954387 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5bc132e1-21a6-43d0-9ccb-5cb7510156ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.954387 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5bc132e1-21a6-43d0-9ccb-5cb7510156ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:25.954835 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5bc132e1-21a6-43d0-9ccb-5cb7510156ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:25.962363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d81fd0da-51ac-4a93-adc1-530939a016e5 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 37201 microversion: 2.20 time: 0.103887 Dec 15 13:41:25.963090 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 357/705] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:25 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 37201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:26.029677 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5bc132e1-21a6-43d0-9ccb-5cb7510156ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28658 microversion: 2.1 time: 0.087754 Dec 15 13:41:26.030393 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 349/706] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:25 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28658 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:26.075666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5a9a2227-0b07-4122-8859-656774673039 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:26.076600 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5a9a2227-0b07-4122-8859-656774673039 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:26.083941 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5a9a2227-0b07-4122-8859-656774673039 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:26.084382 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5a9a2227-0b07-4122-8859-656774673039 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:26.085413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5a9a2227-0b07-4122-8859-656774673039 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:26.085937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5a9a2227-0b07-4122-8859-656774673039 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:26.168312 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5a9a2227-0b07-4122-8859-656774673039 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:26.176424 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5a9a2227-0b07-4122-8859-656774673039 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1211 microversion: 2.1 time: 0.105456 Dec 15 13:41:26.177366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 358/707] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:26 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:26.975416 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-bb566425-e5d4-4f2f-a65c-60ad33290e8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:26.976435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-bb566425-e5d4-4f2f-a65c-60ad33290e8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:26.984473 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bb566425-e5d4-4f2f-a65c-60ad33290e8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:26.985158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bb566425-e5d4-4f2f-a65c-60ad33290e8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:26.986157 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bb566425-e5d4-4f2f-a65c-60ad33290e8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:26.986589 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bb566425-e5d4-4f2f-a65c-60ad33290e8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.040839 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a72f3d47-0044-43cb-b509-d87cc32d288f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:27.041749 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a72f3d47-0044-43cb-b509-d87cc32d288f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:27.048398 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a72f3d47-0044-43cb-b509-d87cc32d288f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.048824 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a72f3d47-0044-43cb-b509-d87cc32d288f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.049678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a72f3d47-0044-43cb-b509-d87cc32d288f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.050175 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a72f3d47-0044-43cb-b509-d87cc32d288f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.065207 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-bb566425-e5d4-4f2f-a65c-60ad33290e8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 38235 microversion: 2.20 time: 0.094038 Dec 15 13:41:27.066166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 350/708] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:26 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 38235 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:27.129781 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a72f3d47-0044-43cb-b509-d87cc32d288f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 28795 microversion: 2.1 time: 0.092449 Dec 15 13:41:27.130442 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 359/709] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:27 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 28795 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:27.195107 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6d26f892-0ece-4506-b1c8-4502b9d64b64 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:27.196328 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6d26f892-0ece-4506-b1c8-4502b9d64b64 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:27.204528 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6d26f892-0ece-4506-b1c8-4502b9d64b64 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.205328 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6d26f892-0ece-4506-b1c8-4502b9d64b64 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.206653 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6d26f892-0ece-4506-b1c8-4502b9d64b64 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.207205 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6d26f892-0ece-4506-b1c8-4502b9d64b64 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.488805 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-861dd560-07b7-48ad-9070-f16451b1cacc req-ff2f347f-7727-4da2-b6aa-277b530ec119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1f13b7-ec74-46ef-804f-57424152547a", "tag": "4e829204-dbd1-42b8-a2ff-635b2e378baf"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:27.490232 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:41:27.490232 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:41:27.498350 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-861dd560-07b7-48ad-9070-f16451b1cacc req-ff2f347f-7727-4da2-b6aa-277b530ec119 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:27.500924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-861dd560-07b7-48ad-9070-f16451b1cacc req-ff2f347f-7727-4da2-b6aa-277b530ec119 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:27.516760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-861dd560-07b7-48ad-9070-f16451b1cacc req-ff2f347f-7727-4da2-b6aa-277b530ec119 service nova] Creating event network-changed:4e829204-dbd1-42b8-a2ff-635b2e378baf for instance 3e1f13b7-ec74-46ef-804f-57424152547a on hv-cinder-81322 Dec 15 13:41:27.521690 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-861dd560-07b7-48ad-9070-f16451b1cacc req-ff2f347f-7727-4da2-b6aa-277b530ec119 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037159 Dec 15 13:41:27.522346 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 360/710] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:41:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:41:27.580216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6d26f892-0ece-4506-b1c8-4502b9d64b64 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:27.588462 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6d26f892-0ece-4506-b1c8-4502b9d64b64 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.397800 Dec 15 13:41:27.589283 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 351/711] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:27 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:28.080190 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3a58eb46-aa68-45d0-a470-4d006ae5cb58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:28.081172 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3a58eb46-aa68-45d0-a470-4d006ae5cb58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:28.087732 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3a58eb46-aa68-45d0-a470-4d006ae5cb58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:28.088615 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3a58eb46-aa68-45d0-a470-4d006ae5cb58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:28.089392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3a58eb46-aa68-45d0-a470-4d006ae5cb58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:28.089913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3a58eb46-aa68-45d0-a470-4d006ae5cb58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:28.141417 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a2f1fc50-1207-47b6-b0e0-299e358e0622 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:28.142360 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a2f1fc50-1207-47b6-b0e0-299e358e0622 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:28.149137 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a2f1fc50-1207-47b6-b0e0-299e358e0622 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:28.149579 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a2f1fc50-1207-47b6-b0e0-299e358e0622 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:28.150376 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a2f1fc50-1207-47b6-b0e0-299e358e0622 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:28.150810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a2f1fc50-1207-47b6-b0e0-299e358e0622 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:28.163323 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3a58eb46-aa68-45d0-a470-4d006ae5cb58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 38235 microversion: 2.20 time: 0.089152 Dec 15 13:41:28.164002 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 361/712] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:28 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 38235 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:28.241632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a2f1fc50-1207-47b6-b0e0-299e358e0622 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 30577 microversion: 2.1 time: 0.104406 Dec 15 13:41:28.242323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 352/713] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:28 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 30577 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:28.609196 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c9990588-37df-494d-9be5-73ddcfaf9df7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:28.609934 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c9990588-37df-494d-9be5-73ddcfaf9df7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:28.616684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9990588-37df-494d-9be5-73ddcfaf9df7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:28.617152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9990588-37df-494d-9be5-73ddcfaf9df7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:28.617952 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9990588-37df-494d-9be5-73ddcfaf9df7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:28.618382 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c9990588-37df-494d-9be5-73ddcfaf9df7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:28.803462 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c9990588-37df-494d-9be5-73ddcfaf9df7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:28.810627 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c9990588-37df-494d-9be5-73ddcfaf9df7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.205930 Dec 15 13:41:28.811184 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 362/714] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:28 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:29.176172 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6519550a-a3de-4576-888b-aed725285ca8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:29.177156 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6519550a-a3de-4576-888b-aed725285ca8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:29.183892 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6519550a-a3de-4576-888b-aed725285ca8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.184892 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6519550a-a3de-4576-888b-aed725285ca8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.185656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6519550a-a3de-4576-888b-aed725285ca8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.186106 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6519550a-a3de-4576-888b-aed725285ca8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.246311 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6519550a-a3de-4576-888b-aed725285ca8 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 38235 microversion: 2.20 time: 0.074043 Dec 15 13:41:29.247583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 353/715] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:29 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 38235 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:29.253405 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-efda978e-9a1f-43f0-b7c6-a8e080b2dd82 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:29.254340 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-efda978e-9a1f-43f0-b7c6-a8e080b2dd82 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:29.260573 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-efda978e-9a1f-43f0-b7c6-a8e080b2dd82 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.261118 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-efda978e-9a1f-43f0-b7c6-a8e080b2dd82 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.261943 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-efda978e-9a1f-43f0-b7c6-a8e080b2dd82 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.262371 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-efda978e-9a1f-43f0-b7c6-a8e080b2dd82 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.341026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-efda978e-9a1f-43f0-b7c6-a8e080b2dd82 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 32348 microversion: 2.1 time: 0.088845 Dec 15 13:41:29.341669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 363/716] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:29 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 32348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:29.827932 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-16752f2d-df4d-44bb-b933-b1df91c1779e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:29.828913 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-16752f2d-df4d-44bb-b933-b1df91c1779e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:29.837107 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-16752f2d-df4d-44bb-b933-b1df91c1779e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.837541 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-16752f2d-df4d-44bb-b933-b1df91c1779e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.838353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-16752f2d-df4d-44bb-b933-b1df91c1779e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:29.838784 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-16752f2d-df4d-44bb-b933-b1df91c1779e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:29.990846 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-16752f2d-df4d-44bb-b933-b1df91c1779e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:29.999108 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-16752f2d-df4d-44bb-b933-b1df91c1779e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.175472 Dec 15 13:41:29.999696 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 354/717] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:29 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:30.259008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-93e6234a-9b68-48aa-a3a1-13c8934fdca7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:30.259944 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-93e6234a-9b68-48aa-a3a1-13c8934fdca7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:30.266822 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-93e6234a-9b68-48aa-a3a1-13c8934fdca7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:30.267264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-93e6234a-9b68-48aa-a3a1-13c8934fdca7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:30.268038 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-93e6234a-9b68-48aa-a3a1-13c8934fdca7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:30.268464 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-93e6234a-9b68-48aa-a3a1-13c8934fdca7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:30.351025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-93e6234a-9b68-48aa-a3a1-13c8934fdca7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 38250 microversion: 2.20 time: 0.096018 Dec 15 13:41:30.351878 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 364/718] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:30 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 38250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:30.352414 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-780d88f5-5898-42d8-9bd5-649cbd9db87c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:30.353316 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-780d88f5-5898-42d8-9bd5-649cbd9db87c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:30.360631 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-780d88f5-5898-42d8-9bd5-649cbd9db87c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:30.361073 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-780d88f5-5898-42d8-9bd5-649cbd9db87c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:30.361881 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-780d88f5-5898-42d8-9bd5-649cbd9db87c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:30.362308 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-780d88f5-5898-42d8-9bd5-649cbd9db87c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:30.439191 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-780d88f5-5898-42d8-9bd5-649cbd9db87c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 33500 microversion: 2.1 time: 0.090320 Dec 15 13:41:30.439815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 355/719] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:30 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 33500 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:31.017550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0cb2b622-f0cb-4cfc-bc6c-9e3c718daf77 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:31.018193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0cb2b622-f0cb-4cfc-bc6c-9e3c718daf77 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:31.025227 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0cb2b622-f0cb-4cfc-bc6c-9e3c718daf77 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:31.025677 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0cb2b622-f0cb-4cfc-bc6c-9e3c718daf77 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.026492 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0cb2b622-f0cb-4cfc-bc6c-9e3c718daf77 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:31.026929 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0cb2b622-f0cb-4cfc-bc6c-9e3c718daf77 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.156088 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0cb2b622-f0cb-4cfc-bc6c-9e3c718daf77 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:31.163926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0cb2b622-f0cb-4cfc-bc6c-9e3c718daf77 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.150482 Dec 15 13:41:31.164482 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 365/720] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:31 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:31.363183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ae647d13-4989-4e06-9dd8-50d8b47025cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:31.364165 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ae647d13-4989-4e06-9dd8-50d8b47025cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:31.370903 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ae647d13-4989-4e06-9dd8-50d8b47025cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:31.371342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ae647d13-4989-4e06-9dd8-50d8b47025cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.372103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ae647d13-4989-4e06-9dd8-50d8b47025cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:31.372527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ae647d13-4989-4e06-9dd8-50d8b47025cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.446889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ae647d13-4989-4e06-9dd8-50d8b47025cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 200 len: 38378 microversion: 2.20 time: 0.087595 Dec 15 13:41:31.447774 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 356/721] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:31 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 38378 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:41:31.451331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f5bfbeb8-7354-4016-b267-34e6704ade08 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:31.452245 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f5bfbeb8-7354-4016-b267-34e6704ade08 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:31.458194 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8df2839a-02ac-42ee-a682-8a206ac9416f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:31.458580 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f5bfbeb8-7354-4016-b267-34e6704ade08 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:31.458794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8df2839a-02ac-42ee-a682-8a206ac9416f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:31.459017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f5bfbeb8-7354-4016-b267-34e6704ade08 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.459788 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f5bfbeb8-7354-4016-b267-34e6704ade08 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:31.460217 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f5bfbeb8-7354-4016-b267-34e6704ade08 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.466426 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8df2839a-02ac-42ee-a682-8a206ac9416f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:31.466872 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8df2839a-02ac-42ee-a682-8a206ac9416f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.467643 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8df2839a-02ac-42ee-a682-8a206ac9416f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:31.468104 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8df2839a-02ac-42ee-a682-8a206ac9416f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:31.492717 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8df2839a-02ac-42ee-a682-8a206ac9416f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/ips" status: 200 len: 152 microversion: 2.20 time: 0.038327 Dec 15 13:41:31.493276 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 357/722] 10.222.0.83 () {60 vars in 1288 bytes} [Wed Dec 15 13:41:31 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:31.545342 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f5bfbeb8-7354-4016-b267-34e6704ade08 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 34540 microversion: 2.1 time: 0.098005 Dec 15 13:41:31.549369 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 366/723] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:31 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 34540 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:32.180347 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-10a2cfd7-00ff-496c-ab2c-c3c729eafd6d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:32.180865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-10a2cfd7-00ff-496c-ab2c-c3c729eafd6d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:32.187870 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10a2cfd7-00ff-496c-ab2c-c3c729eafd6d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:32.188310 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10a2cfd7-00ff-496c-ab2c-c3c729eafd6d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:32.189091 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10a2cfd7-00ff-496c-ab2c-c3c729eafd6d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:32.189518 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10a2cfd7-00ff-496c-ab2c-c3c729eafd6d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:32.332237 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-10a2cfd7-00ff-496c-ab2c-c3c729eafd6d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:32.339782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-10a2cfd7-00ff-496c-ab2c-c3c729eafd6d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.163222 Dec 15 13:41:32.340417 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 358/724] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:32 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:32.557466 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-47e568e2-96ba-4d25-959f-053a107e9584 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:32.558396 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-47e568e2-96ba-4d25-959f-053a107e9584 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:32.565151 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-47e568e2-96ba-4d25-959f-053a107e9584 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:32.565593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-47e568e2-96ba-4d25-959f-053a107e9584 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:32.566395 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-47e568e2-96ba-4d25-959f-053a107e9584 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:32.566826 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-47e568e2-96ba-4d25-959f-053a107e9584 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:32.646992 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-47e568e2-96ba-4d25-959f-053a107e9584 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 35503 microversion: 2.1 time: 0.093387 Dec 15 13:41:32.647687 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 367/725] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:32 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 35503 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:33.357460 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3b6f8b26-9ed8-4077-9a91-13ab964b3843 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:33.358105 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3b6f8b26-9ed8-4077-9a91-13ab964b3843 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:33.365022 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3b6f8b26-9ed8-4077-9a91-13ab964b3843 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:33.365467 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3b6f8b26-9ed8-4077-9a91-13ab964b3843 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:33.366279 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3b6f8b26-9ed8-4077-9a91-13ab964b3843 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:33.366711 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3b6f8b26-9ed8-4077-9a91-13ab964b3843 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:33.520471 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3b6f8b26-9ed8-4077-9a91-13ab964b3843 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:33.529598 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3b6f8b26-9ed8-4077-9a91-13ab964b3843 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.176860 Dec 15 13:41:33.530219 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 359/726] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:33 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:33.660092 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-abe4d85b-b748-48cf-8d3e-fdb3588c7cc5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:33.661158 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-abe4d85b-b748-48cf-8d3e-fdb3588c7cc5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:33.671061 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-abe4d85b-b748-48cf-8d3e-fdb3588c7cc5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:33.671522 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-abe4d85b-b748-48cf-8d3e-fdb3588c7cc5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:33.672384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-abe4d85b-b748-48cf-8d3e-fdb3588c7cc5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:33.672822 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-abe4d85b-b748-48cf-8d3e-fdb3588c7cc5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:33.755510 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-abe4d85b-b748-48cf-8d3e-fdb3588c7cc5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 36591 microversion: 2.1 time: 0.099374 Dec 15 13:41:33.756142 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 368/727] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:33 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 36591 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:33.905811 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d492c5b6-0fda-4f28-8851-d59ec204eb10 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:33.906349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d492c5b6-0fda-4f28-8851-d59ec204eb10 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:33.912897 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d492c5b6-0fda-4f28-8851-d59ec204eb10 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:33.913354 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d492c5b6-0fda-4f28-8851-d59ec204eb10 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:33.914183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d492c5b6-0fda-4f28-8851-d59ec204eb10 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:33.914622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d492c5b6-0fda-4f28-8851-d59ec204eb10 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:33.940244 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-d492c5b6-0fda-4f28-8851-d59ec204eb10 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lazy-loading 'flavor' on Instance uuid 8832f44d-71e8-44e3-b955-88a3285a3cb2 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:41:34.188584 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d492c5b6-0fda-4f28-8851-d59ec204eb10 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 202 len: 0 microversion: 2.20 time: 0.287176 Dec 15 13:41:34.189367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 360/728] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:41:33 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:41:34.198347 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:34.199022 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:34.206691 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:34.207134 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:34.208082 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:34.209226 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:34.342241 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:34.350238 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:34.351714 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:34.352833 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c40f4b54-d83c-4377-8b56-681db97abd35 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.159267 Dec 15 13:41:34.353382 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 369/729] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:34 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:34.546616 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a953d5d1-f47f-4721-907e-5a3b2f34fa0c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:34.547224 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a953d5d1-f47f-4721-907e-5a3b2f34fa0c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:34.553630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a953d5d1-f47f-4721-907e-5a3b2f34fa0c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:34.554112 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a953d5d1-f47f-4721-907e-5a3b2f34fa0c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:34.554891 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a953d5d1-f47f-4721-907e-5a3b2f34fa0c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:34.555330 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a953d5d1-f47f-4721-907e-5a3b2f34fa0c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:34.688433 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a953d5d1-f47f-4721-907e-5a3b2f34fa0c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:34.695556 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a953d5d1-f47f-4721-907e-5a3b2f34fa0c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.153668 Dec 15 13:41:34.696107 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 361/730] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:34 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:34.767297 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4130c927-e09b-435d-925c-81207f098124 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:34.768202 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4130c927-e09b-435d-925c-81207f098124 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:34.774433 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4130c927-e09b-435d-925c-81207f098124 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:34.774873 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4130c927-e09b-435d-925c-81207f098124 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:34.775628 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4130c927-e09b-435d-925c-81207f098124 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:34.776056 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4130c927-e09b-435d-925c-81207f098124 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:34.859885 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4130c927-e09b-435d-925c-81207f098124 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 37766 microversion: 2.1 time: 0.096048 Dec 15 13:41:34.860524 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 370/731] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:34 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 37766 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:35.372938 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:35.373535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:35.379437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:35.379887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:35.380664 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:35.381092 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:35.509264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:35.517005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:35.518516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:35.519664 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-31d3dc77-5ef1-4dd9-9d72-39ddbe156572 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.151055 Dec 15 13:41:35.520226 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 362/732] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:35 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:35.712820 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-40ef57a0-8e20-4d18-94e4-5ac4886d1483 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:35.713503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-40ef57a0-8e20-4d18-94e4-5ac4886d1483 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:35.721025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-40ef57a0-8e20-4d18-94e4-5ac4886d1483 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:35.721463 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-40ef57a0-8e20-4d18-94e4-5ac4886d1483 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:35.722264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-40ef57a0-8e20-4d18-94e4-5ac4886d1483 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:35.722765 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-40ef57a0-8e20-4d18-94e4-5ac4886d1483 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:35.862644 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-40ef57a0-8e20-4d18-94e4-5ac4886d1483 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:35.870951 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-40ef57a0-8e20-4d18-94e4-5ac4886d1483 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.161789 Dec 15 13:41:35.872359 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9b848ebb-1e04-4acd-8aaa-e11e2bc8940f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:35.873339 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9b848ebb-1e04-4acd-8aaa-e11e2bc8940f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:35.875481 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 371/733] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:35 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:35.883969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9b848ebb-1e04-4acd-8aaa-e11e2bc8940f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:35.884413 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9b848ebb-1e04-4acd-8aaa-e11e2bc8940f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:35.885198 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9b848ebb-1e04-4acd-8aaa-e11e2bc8940f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:35.885633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9b848ebb-1e04-4acd-8aaa-e11e2bc8940f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:35.976331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9b848ebb-1e04-4acd-8aaa-e11e2bc8940f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 38188 microversion: 2.1 time: 0.107606 Dec 15 13:41:35.976889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 363/734] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:35 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 38188 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:36.538942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:36.539572 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:36.545734 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.546206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.546982 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.547410 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.676505 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:36.684168 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:36.686228 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:36.687394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fd1c8803-260d-40f2-b14c-5e88cf5bd6af tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.152276 Dec 15 13:41:36.687950 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 372/735] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:36 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:36.887002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2cd5bc9b-b120-4dc4-aebe-787da39a2017 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:36.887685 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2cd5bc9b-b120-4dc4-aebe-787da39a2017 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:36.894746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2cd5bc9b-b120-4dc4-aebe-787da39a2017 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.895201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2cd5bc9b-b120-4dc4-aebe-787da39a2017 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.896022 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2cd5bc9b-b120-4dc4-aebe-787da39a2017 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.896458 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2cd5bc9b-b120-4dc4-aebe-787da39a2017 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.988378 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b551d6f1-28ff-4814-90b9-830e6c51a216 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:36.989401 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b551d6f1-28ff-4814-90b9-830e6c51a216 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:36.995459 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b551d6f1-28ff-4814-90b9-830e6c51a216 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.995984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b551d6f1-28ff-4814-90b9-830e6c51a216 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:36.997661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b551d6f1-28ff-4814-90b9-830e6c51a216 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:36.998205 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b551d6f1-28ff-4814-90b9-830e6c51a216 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:37.029567 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2cd5bc9b-b120-4dc4-aebe-787da39a2017 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:37.036824 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2cd5bc9b-b120-4dc4-aebe-787da39a2017 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.153842 Dec 15 13:41:37.037388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 364/736] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:36 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:37.064513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b551d6f1-28ff-4814-90b9-830e6c51a216 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 38188 microversion: 2.1 time: 0.079666 Dec 15 13:41:37.065173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 373/737] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:36 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 38188 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:37.706047 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:37.706676 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:37.713190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:37.713638 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:37.714486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:37.714923 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:37.845031 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:37.852670 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:37.854297 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:37.855448 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7c590f8a-7610-4897-bc87-055a74ee0fa3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.153176 Dec 15 13:41:37.856013 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 365/738] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:37 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:38.054542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fab5e384-4987-4fc0-b5ba-34be9b3abd41 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:38.055145 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fab5e384-4987-4fc0-b5ba-34be9b3abd41 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:38.062543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fab5e384-4987-4fc0-b5ba-34be9b3abd41 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:38.062992 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fab5e384-4987-4fc0-b5ba-34be9b3abd41 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:38.063767 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fab5e384-4987-4fc0-b5ba-34be9b3abd41 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:38.064197 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fab5e384-4987-4fc0-b5ba-34be9b3abd41 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:38.076697 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cc940b32-b7dc-4b39-b015-4242e45da549 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:38.077600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cc940b32-b7dc-4b39-b015-4242e45da549 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:38.083807 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cc940b32-b7dc-4b39-b015-4242e45da549 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:38.084312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cc940b32-b7dc-4b39-b015-4242e45da549 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:38.085013 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cc940b32-b7dc-4b39-b015-4242e45da549 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:38.085443 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cc940b32-b7dc-4b39-b015-4242e45da549 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:38.154920 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cc940b32-b7dc-4b39-b015-4242e45da549 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 38188 microversion: 2.1 time: 0.082154 Dec 15 13:41:38.155566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 366/739] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:38 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 38188 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:41:38.199721 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fab5e384-4987-4fc0-b5ba-34be9b3abd41 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:38.207469 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fab5e384-4987-4fc0-b5ba-34be9b3abd41 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.157029 Dec 15 13:41:38.208039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 374/740] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:38 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:38.874687 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:38.875500 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:38.882161 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:38.882601 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:38.883376 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:38.883804 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:39.061510 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:39.069436 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:39.070935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:39.072079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2c306e72-0e01-4f0d-a165-d5ce56a76ae1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.201479 Dec 15 13:41:39.072630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 367/741] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:38 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:39.166727 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f87bb805-e7bb-430d-8a7e-5410c6ad70ec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:39.167645 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f87bb805-e7bb-430d-8a7e-5410c6ad70ec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:39.173908 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f87bb805-e7bb-430d-8a7e-5410c6ad70ec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:39.174408 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f87bb805-e7bb-430d-8a7e-5410c6ad70ec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:39.175206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f87bb805-e7bb-430d-8a7e-5410c6ad70ec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:39.175675 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f87bb805-e7bb-430d-8a7e-5410c6ad70ec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:39.224361 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cdce2ae4-48b1-47c9-a1de-d42dc91f9e5d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:39.224988 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cdce2ae4-48b1-47c9-a1de-d42dc91f9e5d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:39.231265 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cdce2ae4-48b1-47c9-a1de-d42dc91f9e5d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:39.231799 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cdce2ae4-48b1-47c9-a1de-d42dc91f9e5d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:39.232604 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cdce2ae4-48b1-47c9-a1de-d42dc91f9e5d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:39.233034 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cdce2ae4-48b1-47c9-a1de-d42dc91f9e5d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:39.261905 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f87bb805-e7bb-430d-8a7e-5410c6ad70ec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 200 len: 38318 microversion: 2.1 time: 0.098670 Dec 15 13:41:39.262582 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 375/742] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:39 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 38318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:41:39.273320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4e4f535b-c2b6-42c0-9644-1de5bce2aeec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:39.273906 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4e4f535b-c2b6-42c0-9644-1de5bce2aeec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:39.280689 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4e4f535b-c2b6-42c0-9644-1de5bce2aeec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:39.281130 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4e4f535b-c2b6-42c0-9644-1de5bce2aeec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:39.281946 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4e4f535b-c2b6-42c0-9644-1de5bce2aeec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:39.282685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4e4f535b-c2b6-42c0-9644-1de5bce2aeec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:39.306176 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4e4f535b-c2b6-42c0-9644-1de5bce2aeec tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/ips" status: 200 len: 145 microversion: 2.1 time: 0.036594 Dec 15 13:41:39.310099 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 376/743] 10.222.0.83 () {58 vars in 1247 bytes} [Wed Dec 15 13:41:39 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:41:39.443046 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cdce2ae4-48b1-47c9-a1de-d42dc91f9e5d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:39.458604 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cdce2ae4-48b1-47c9-a1de-d42dc91f9e5d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.237986 Dec 15 13:41:39.459382 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 368/744] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:39 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:39.475439 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-d69d85f1-4c90-418b-999a-c1672205725e req-669f5447-7f7c-4931-a678-b530409950f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1f13b7-ec74-46ef-804f-57424152547a", "name": "network-vif-plugged", "status": "completed", "tag": "4e829204-dbd1-42b8-a2ff-635b2e378baf"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:39.477354 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:41:39.477354 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:41:39.486288 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-d69d85f1-4c90-418b-999a-c1672205725e req-669f5447-7f7c-4931-a678-b530409950f4 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:39.486829 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-d69d85f1-4c90-418b-999a-c1672205725e req-669f5447-7f7c-4931-a678-b530409950f4 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:39.499486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-d69d85f1-4c90-418b-999a-c1672205725e req-669f5447-7f7c-4931-a678-b530409950f4 service nova] Creating event network-vif-plugged:4e829204-dbd1-42b8-a2ff-635b2e378baf for instance 3e1f13b7-ec74-46ef-804f-57424152547a on hv-cinder-81322 Dec 15 13:41:39.504372 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-d69d85f1-4c90-418b-999a-c1672205725e req-669f5447-7f7c-4931-a678-b530409950f4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035133 Dec 15 13:41:39.505144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 377/745] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:41:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:41:40.092015 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:40.092561 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:40.098809 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:40.099254 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:40.100192 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:40.100723 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:40.236306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:40.244649 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:40.246259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:40.247436 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8576b53a-0aaf-4de7-8fcd-a14e9965d55a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.159851 Dec 15 13:41:40.248192 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 369/746] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:40 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:40.477394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1cf3aed2-c80d-48f5-85f9-4822a1c55c56 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:40.478335 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1cf3aed2-c80d-48f5-85f9-4822a1c55c56 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:40.484660 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1cf3aed2-c80d-48f5-85f9-4822a1c55c56 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:40.485108 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1cf3aed2-c80d-48f5-85f9-4822a1c55c56 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:40.485945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1cf3aed2-c80d-48f5-85f9-4822a1c55c56 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:40.486415 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1cf3aed2-c80d-48f5-85f9-4822a1c55c56 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:40.630873 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1cf3aed2-c80d-48f5-85f9-4822a1c55c56 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:40.638711 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1cf3aed2-c80d-48f5-85f9-4822a1c55c56 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1267 microversion: 2.1 time: 0.166285 Dec 15 13:41:40.639266 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 378/747] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:40 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:41.266497 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:41.267630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:41.274211 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:41.274654 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:41.275429 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:41.275855 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:41.407141 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:41.414796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:41.416291 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:41.417442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-383e0542-46a1-4880-a7b4-69645f15c931 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.155076 Dec 15 13:41:41.418097 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 370/748] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:41 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:41.431747 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fbb6ab5a-a75b-4c67-a68f-ce1a63c7ec55 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96a6eda8-874a-4e36-9418-4c1da7e9ecb1"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:41.432835 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fbb6ab5a-a75b-4c67-a68f-ce1a63c7ec55 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:41.439663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fbb6ab5a-a75b-4c67-a68f-ce1a63c7ec55 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:41.440103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fbb6ab5a-a75b-4c67-a68f-ce1a63c7ec55 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:41.440866 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fbb6ab5a-a75b-4c67-a68f-ce1a63c7ec55 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:41.441294 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fbb6ab5a-a75b-4c67-a68f-ce1a63c7ec55 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:41.656121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-50fadcc7-37eb-4798-8bbd-09f43a0d741a tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:41.656878 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-50fadcc7-37eb-4798-8bbd-09f43a0d741a tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:41.663866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-50fadcc7-37eb-4798-8bbd-09f43a0d741a tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:41.664307 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-50fadcc7-37eb-4798-8bbd-09f43a0d741a tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:41.665130 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-50fadcc7-37eb-4798-8bbd-09f43a0d741a tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:41.665566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-50fadcc7-37eb-4798-8bbd-09f43a0d741a tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:41.667734 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fbb6ab5a-a75b-4c67-a68f-ce1a63c7ec55 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239554 Dec 15 13:41:41.668530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 379/749] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:41:41 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:41.822109 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-50fadcc7-37eb-4798-8bbd-09f43a0d741a tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:41.829592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-50fadcc7-37eb-4798-8bbd-09f43a0d741a tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1454 microversion: 2.1 time: 0.177822 Dec 15 13:41:41.830140 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 371/750] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:41 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:41.846572 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-77866a86-ff9b-4bc8-980c-dd465a4bb9c3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:41.847266 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-77866a86-ff9b-4bc8-980c-dd465a4bb9c3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:41.853659 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-77866a86-ff9b-4bc8-980c-dd465a4bb9c3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:41.854225 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-77866a86-ff9b-4bc8-980c-dd465a4bb9c3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:41.855008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-77866a86-ff9b-4bc8-980c-dd465a4bb9c3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:41.855443 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-77866a86-ff9b-4bc8-980c-dd465a4bb9c3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:41.990058 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-77866a86-ff9b-4bc8-980c-dd465a4bb9c3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:41.997598 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-77866a86-ff9b-4bc8-980c-dd465a4bb9c3 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1454 microversion: 2.1 time: 0.154866 Dec 15 13:41:41.998206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 380/751] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:41 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:42.436984 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:42.437865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:42.443910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:42.444350 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:42.445120 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:42.445544 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:42.947615 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:42.955370 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:42.956872 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:42.958087 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4ac86045-0598-4878-be05-77d86895c2d2 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.525475 Dec 15 13:41:42.958641 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 372/752] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:42 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:43.873013 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-8f261820-e03a-4bb2-a149-8c66645e4634 req-0b92126d-44e2-4cad-ab54-61104411a9af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1f13b7-ec74-46ef-804f-57424152547a", "tag": "4e829204-dbd1-42b8-a2ff-635b2e378baf"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:43.874586 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:41:43.874586 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:41:43.883163 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-8f261820-e03a-4bb2-a149-8c66645e4634 req-0b92126d-44e2-4cad-ab54-61104411a9af service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:43.883606 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-8f261820-e03a-4bb2-a149-8c66645e4634 req-0b92126d-44e2-4cad-ab54-61104411a9af service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:43.894952 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-8f261820-e03a-4bb2-a149-8c66645e4634 req-0b92126d-44e2-4cad-ab54-61104411a9af service nova] Creating event network-changed:4e829204-dbd1-42b8-a2ff-635b2e378baf for instance 3e1f13b7-ec74-46ef-804f-57424152547a on hv-cinder-81322 Dec 15 13:41:43.899671 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-8f261820-e03a-4bb2-a149-8c66645e4634 req-0b92126d-44e2-4cad-ab54-61104411a9af service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030330 Dec 15 13:41:43.900244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 381/753] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:41:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:41:43.980646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:43.982386 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:43.992538 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:43.993273 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:43.994607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:43.995341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:44.226816 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:44.236508 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:44.238068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:44.239246 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-837dd3aa-10c2-4711-a6e8-6049ec629432 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.265143 Dec 15 13:41:44.239803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 373/754] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:43 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:45.258962 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:45.259650 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:45.266406 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:45.266853 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:45.267619 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:45.268048 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:45.397690 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:45.405641 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:45.407342 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:45.408540 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-756ebf4a-687f-46df-a821-338008a39914 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.154100 Dec 15 13:41:45.409099 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 382/755] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:45 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:41:46.437359 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:46.437990 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:46.444584 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:46.445027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:46.445828 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:46.446257 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:46.585537 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:46.597339 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:46.599663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:46.601368 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-689c13b6-c037-4485-85e2-84df611e3cd3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.167998 Dec 15 13:41:46.602138 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 374/756] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:46 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:47.627293 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:47.627897 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:47.634274 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:47.634716 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:47.635486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:47.635912 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:47.772287 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:47.780020 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:47.781497 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:47.782667 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b75a3f2e-a905-4a5f-a91a-642e6844a7cc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.159114 Dec 15 13:41:47.783225 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 383/757] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:47 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:48.802972 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:48.803818 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:48.809881 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:48.810331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:48.811105 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:48.811529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:48.944777 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:48.952483 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:48.953983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:48.955123 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5a379d83-4377-4086-b68b-d0b169ea478e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.155923 Dec 15 13:41:48.955679 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 375/758] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:48 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:49.139133 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-93816ac6-e9d7-4862-9d1f-922b40d10b70 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:49.145401 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-93816ac6-e9d7-4862-9d1f-922b40d10b70 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:49.145895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-93816ac6-e9d7-4862-9d1f-922b40d10b70 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:49.205121 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-93816ac6-e9d7-4862-9d1f-922b40d10b70 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Going to try to stop instance {{(pid=122611) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 13:41:49.247146 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-93816ac6-e9d7-4862-9d1f-922b40d10b70 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 202 len: 0 microversion: 2.1 time: 0.111960 Dec 15 13:41:49.247739 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 384/759] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:41:49 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:41:49.255658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d9fd9a23-fdaa-4b72-a711-44cec77475d0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:49.256347 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d9fd9a23-fdaa-4b72-a711-44cec77475d0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:49.263183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d9fd9a23-fdaa-4b72-a711-44cec77475d0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:49.263645 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d9fd9a23-fdaa-4b72-a711-44cec77475d0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:49.264435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d9fd9a23-fdaa-4b72-a711-44cec77475d0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:49.264865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d9fd9a23-fdaa-4b72-a711-44cec77475d0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:49.398340 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d9fd9a23-fdaa-4b72-a711-44cec77475d0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:49.406343 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d9fd9a23-fdaa-4b72-a711-44cec77475d0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.154263 Dec 15 13:41:49.406915 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 376/760] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:49 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:49.974641 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:49.975272 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:49.981352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:49.982343 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:49.983104 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:49.983530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:50.113025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:50.120701 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:50.122836 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:50.124012 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-54003af1-3b7e-4556-b8d4-6ee940b85a29 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1746 microversion: 2.20 time: 0.153499 Dec 15 13:41:50.124572 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 385/761] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:49 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:50.425182 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1520652f-7218-42ff-9f08-d4b1b37fedae tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:50.425800 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1520652f-7218-42ff-9f08-d4b1b37fedae tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:50.432002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1520652f-7218-42ff-9f08-d4b1b37fedae tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:50.432443 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1520652f-7218-42ff-9f08-d4b1b37fedae tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:50.433206 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1520652f-7218-42ff-9f08-d4b1b37fedae tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:50.433631 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1520652f-7218-42ff-9f08-d4b1b37fedae tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:50.562333 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1520652f-7218-42ff-9f08-d4b1b37fedae tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:50.570010 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1520652f-7218-42ff-9f08-d4b1b37fedae tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.148443 Dec 15 13:41:50.570576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 377/762] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:50 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:51.143109 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:51.143918 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:51.150089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:51.150528 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:51.151288 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:51.151710 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:51.284170 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:51.291899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:51.293363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:51.295014 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ef9a2135-8d5a-45e3-8cb0-4a20f0e25f78 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1746 microversion: 2.20 time: 0.155733 Dec 15 13:41:51.295676 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 386/763] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:51 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:51.587883 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-46f8a73a-c753-456a-8fed-851eb2ffd5f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:51.588516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-46f8a73a-c753-456a-8fed-851eb2ffd5f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:51.594904 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-46f8a73a-c753-456a-8fed-851eb2ffd5f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:51.595355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-46f8a73a-c753-456a-8fed-851eb2ffd5f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:51.596138 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-46f8a73a-c753-456a-8fed-851eb2ffd5f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:51.596571 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-46f8a73a-c753-456a-8fed-851eb2ffd5f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:51.753716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-46f8a73a-c753-456a-8fed-851eb2ffd5f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:51.762238 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-46f8a73a-c753-456a-8fed-851eb2ffd5f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.178198 Dec 15 13:41:51.762857 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 378/764] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:51 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:52.313481 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:52.314110 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:52.321229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:52.321773 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:52.322577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:52.323899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:52.464054 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:52.472183 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:52.474083 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:52.475284 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-dc5d7838-46f4-4729-98b0-29c5cb842d6f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1741 microversion: 2.20 time: 0.165333 Dec 15 13:41:52.475728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 387/765] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:52 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:52.779785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f5cd561a-6fa2-47ac-a5f1-3d3b96020d5b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:52.780394 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f5cd561a-6fa2-47ac-a5f1-3d3b96020d5b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:52.787637 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5cd561a-6fa2-47ac-a5f1-3d3b96020d5b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:52.788197 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5cd561a-6fa2-47ac-a5f1-3d3b96020d5b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:52.789220 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5cd561a-6fa2-47ac-a5f1-3d3b96020d5b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:52.789907 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f5cd561a-6fa2-47ac-a5f1-3d3b96020d5b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:52.952703 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f5cd561a-6fa2-47ac-a5f1-3d3b96020d5b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:52.962462 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f5cd561a-6fa2-47ac-a5f1-3d3b96020d5b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.185058 Dec 15 13:41:52.966954 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 379/766] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:52 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:53.494633 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:53.497310 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:53.504465 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:53.505248 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:53.506213 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:53.506866 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:53.609538 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-e8c3a1cd-c1c6-4970-b84d-0e716a5bd3a3 req-362896a2-6488-4569-b3a2-1dfaabc5797d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8832f44d-71e8-44e3-b955-88a3285a3cb2", "name": "network-vif-plugged", "status": "completed", "tag": "eb6d9258-9d98-4855-ac93-8388249d6cd9"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:41:53.612026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:41:53.612026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:41:53.622279 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-e8c3a1cd-c1c6-4970-b84d-0e716a5bd3a3 req-362896a2-6488-4569-b3a2-1dfaabc5797d service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:53.623556 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-e8c3a1cd-c1c6-4970-b84d-0e716a5bd3a3 req-362896a2-6488-4569-b3a2-1dfaabc5797d service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:53.641995 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-e8c3a1cd-c1c6-4970-b84d-0e716a5bd3a3 req-362896a2-6488-4569-b3a2-1dfaabc5797d service nova] Creating event network-vif-plugged:eb6d9258-9d98-4855-ac93-8388249d6cd9 for instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 on hv-cinder-81322 Dec 15 13:41:53.651382 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-e8c3a1cd-c1c6-4970-b84d-0e716a5bd3a3 req-362896a2-6488-4569-b3a2-1dfaabc5797d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047525 Dec 15 13:41:53.653178 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 380/767] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:41:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:41:53.678429 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:53.689282 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:53.692290 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:53.693678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d8847821-823b-4ed8-9b8a-7af585020643 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1741 microversion: 2.20 time: 0.204168 Dec 15 13:41:53.706686 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 388/768] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:53 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:53.984081 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5d7a9d48-62e5-43ba-bf76-ab4a90323aed tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:53.985962 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5d7a9d48-62e5-43ba-bf76-ab4a90323aed tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:53.994017 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5d7a9d48-62e5-43ba-bf76-ab4a90323aed tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:53.994939 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5d7a9d48-62e5-43ba-bf76-ab4a90323aed tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:53.996147 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5d7a9d48-62e5-43ba-bf76-ab4a90323aed tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:53.996858 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5d7a9d48-62e5-43ba-bf76-ab4a90323aed tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:54.181437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5d7a9d48-62e5-43ba-bf76-ab4a90323aed tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:54.192671 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5d7a9d48-62e5-43ba-bf76-ab4a90323aed tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.215631 Dec 15 13:41:54.193614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 381/769] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:53 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:54.714885 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:54.716666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:54.723464 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:54.723910 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:54.724718 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:54.725333 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:54.880062 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:54.888822 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:54.890359 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:54.891515 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b56a5a13-e349-4db4-92ac-f67b1ba7d54c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1741 microversion: 2.20 time: 0.180748 Dec 15 13:41:54.892229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 389/770] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:54 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:55.214143 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2d5e9d1c-254d-4094-9a5d-0479a9909c84 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:55.214932 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2d5e9d1c-254d-4094-9a5d-0479a9909c84 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:55.222710 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d5e9d1c-254d-4094-9a5d-0479a9909c84 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:55.223159 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d5e9d1c-254d-4094-9a5d-0479a9909c84 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:55.223963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d5e9d1c-254d-4094-9a5d-0479a9909c84 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:55.224397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2d5e9d1c-254d-4094-9a5d-0479a9909c84 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:55.378751 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2d5e9d1c-254d-4094-9a5d-0479a9909c84 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:55.387376 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2d5e9d1c-254d-4094-9a5d-0479a9909c84 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.177219 Dec 15 13:41:55.388301 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 382/771] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:55 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:55.912761 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:55.913732 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:55.923291 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:55.923742 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:55.924532 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:55.924960 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:56.109414 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:56.118525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:56.120070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:56.121227 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-796f67b7-ace6-4253-9245-a0a15a09cb85 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1741 microversion: 2.20 time: 0.214848 Dec 15 13:41:56.122226 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 390/772] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:55 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:56.405560 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-440027a5-bd64-444f-8453-de3b4e5510f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:56.406269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-440027a5-bd64-444f-8453-de3b4e5510f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:56.413124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-440027a5-bd64-444f-8453-de3b4e5510f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:56.413571 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-440027a5-bd64-444f-8453-de3b4e5510f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:56.414395 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-440027a5-bd64-444f-8453-de3b4e5510f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:56.414832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-440027a5-bd64-444f-8453-de3b4e5510f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:56.570479 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-440027a5-bd64-444f-8453-de3b4e5510f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:56.579330 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-440027a5-bd64-444f-8453-de3b4e5510f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.177905 Dec 15 13:41:56.580466 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 383/773] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:56 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:57.143668 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:57.144521 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:57.157316 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:57.157971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:57.158886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:57.159456 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:57.322651 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:57.330823 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:57.332305 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:57.333636 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b31b3b07-168d-4508-af76-95e8ddb54712 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1741 microversion: 2.20 time: 0.194100 Dec 15 13:41:57.346039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 391/774] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:57 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:57.597068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f20a2c98-252e-4836-81ef-f4c2eb5c916a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:57.597627 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f20a2c98-252e-4836-81ef-f4c2eb5c916a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:57.604527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f20a2c98-252e-4836-81ef-f4c2eb5c916a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:57.604976 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f20a2c98-252e-4836-81ef-f4c2eb5c916a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:57.605810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f20a2c98-252e-4836-81ef-f4c2eb5c916a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:57.606255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f20a2c98-252e-4836-81ef-f4c2eb5c916a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:57.775057 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f20a2c98-252e-4836-81ef-f4c2eb5c916a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:57.792211 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f20a2c98-252e-4836-81ef-f4c2eb5c916a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.197038 Dec 15 13:41:57.800327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 384/775] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:57 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:41:58.352667 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:58.354423 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:58.360969 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:58.361523 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:58.362400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:58.362895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:58.502312 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:58.510998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:58.512562 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:58.514304 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ad9941e4-34ae-465b-98fa-c6b5c33f5886 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1741 microversion: 2.20 time: 0.165657 Dec 15 13:41:58.520751 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 392/776] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:58 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:41:58.811832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-fe3aae4e-0c2e-4885-93f3-d051f4af2811 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:58.813317 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-fe3aae4e-0c2e-4885-93f3-d051f4af2811 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:58.821608 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe3aae4e-0c2e-4885-93f3-d051f4af2811 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:58.822280 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe3aae4e-0c2e-4885-93f3-d051f4af2811 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:58.823070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe3aae4e-0c2e-4885-93f3-d051f4af2811 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:58.823508 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fe3aae4e-0c2e-4885-93f3-d051f4af2811 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:58.995451 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-fe3aae4e-0c2e-4885-93f3-d051f4af2811 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:59.005437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-fe3aae4e-0c2e-4885-93f3-d051f4af2811 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.197542 Dec 15 13:41:59.007239 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 385/777] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:41:58 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:41:59.537055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:41:59.537055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:41:59.546369 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:59.547012 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:59.547815 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:41:59.548306 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:41:59.734585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:59.746779 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:59.749479 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:41:59.750056 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-14262b3c-a57e-4dc6-842a-bcd94a2641ef tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1741 microversion: 2.20 time: 0.220377 Dec 15 13:41:59.750636 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 393/778] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:41:59 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:00.025805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9d0b985c-e8f5-44d6-9a01-7788714fdb41 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:00.026628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9d0b985c-e8f5-44d6-9a01-7788714fdb41 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:00.035177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9d0b985c-e8f5-44d6-9a01-7788714fdb41 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:00.035509 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9d0b985c-e8f5-44d6-9a01-7788714fdb41 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:00.036325 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9d0b985c-e8f5-44d6-9a01-7788714fdb41 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:00.036760 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9d0b985c-e8f5-44d6-9a01-7788714fdb41 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:00.199773 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9d0b985c-e8f5-44d6-9a01-7788714fdb41 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:00.210392 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9d0b985c-e8f5-44d6-9a01-7788714fdb41 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.189635 Dec 15 13:42:00.211377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 386/779] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:00 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:00.769204 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:00.770506 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:00.776679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:00.777138 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:00.777970 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:00.778403 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:00.937030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:00.945685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:00.947222 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:00.948585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ee226d44-9733-44a7-9b17-6a7a6c427def tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1741 microversion: 2.20 time: 0.183946 Dec 15 13:42:00.951517 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 394/780] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:00 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:01.228012 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9fed747c-36bb-4ecd-9b6f-7e9dab14015f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:01.228616 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9fed747c-36bb-4ecd-9b6f-7e9dab14015f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:01.234996 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9fed747c-36bb-4ecd-9b6f-7e9dab14015f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:01.235447 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9fed747c-36bb-4ecd-9b6f-7e9dab14015f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:01.236227 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9fed747c-36bb-4ecd-9b6f-7e9dab14015f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:01.236676 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9fed747c-36bb-4ecd-9b6f-7e9dab14015f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:01.368178 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9fed747c-36bb-4ecd-9b6f-7e9dab14015f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:01.376906 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9fed747c-36bb-4ecd-9b6f-7e9dab14015f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.152529 Dec 15 13:42:01.377470 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 387/781] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:01 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:01.967691 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:01.968356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:01.974706 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:01.975157 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:01.975940 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:01.976379 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:02.178098 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:02.186632 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:02.188106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:02.189312 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-306ca2c6-1b6c-4894-9be8-284c2f567124 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1723 microversion: 2.20 time: 0.225571 Dec 15 13:42:02.189826 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 395/782] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:01 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:02.394117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a63a446c-92fb-491d-90fb-f7b99344f0e7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:02.394737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a63a446c-92fb-491d-90fb-f7b99344f0e7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:02.401458 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a63a446c-92fb-491d-90fb-f7b99344f0e7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:02.401951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a63a446c-92fb-491d-90fb-f7b99344f0e7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:02.402762 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a63a446c-92fb-491d-90fb-f7b99344f0e7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:02.403213 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a63a446c-92fb-491d-90fb-f7b99344f0e7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:02.694552 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a63a446c-92fb-491d-90fb-f7b99344f0e7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:02.703015 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a63a446c-92fb-491d-90fb-f7b99344f0e7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.312730 Dec 15 13:42:02.703610 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 388/783] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:02 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:03.208063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:03.208688 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:03.216609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:03.217109 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:03.217926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:03.218361 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:03.358120 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:03.366661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:03.368257 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:03.369503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c7283d47-812a-4cea-bbac-4d15cf6ae646 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1723 microversion: 2.20 time: 0.165262 Dec 15 13:42:03.370113 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 396/784] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:03 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:03.721070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-41ad1c2f-b811-4b6a-8045-cdc06de88645 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:03.721658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-41ad1c2f-b811-4b6a-8045-cdc06de88645 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:03.728026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-41ad1c2f-b811-4b6a-8045-cdc06de88645 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:03.728466 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-41ad1c2f-b811-4b6a-8045-cdc06de88645 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:03.729239 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-41ad1c2f-b811-4b6a-8045-cdc06de88645 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:03.729665 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-41ad1c2f-b811-4b6a-8045-cdc06de88645 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:03.863499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-41ad1c2f-b811-4b6a-8045-cdc06de88645 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:03.875781 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-41ad1c2f-b811-4b6a-8045-cdc06de88645 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1723 microversion: 2.1 time: 0.158209 Dec 15 13:42:03.876676 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 389/785] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:03 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:04.390037 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:04.390644 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:04.397611 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:04.398096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:04.398906 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:04.399338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:04.533317 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:04.541283 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:04.542790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:04.543939 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-311c82d9-2221-4790-ba76-96460ddb62ee tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1723 microversion: 2.20 time: 0.157603 Dec 15 13:42:04.545078 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 397/786] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:04 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:42:04.895104 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-bdc0ee34-4404-4862-a0eb-122ad024e617 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:04.895900 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-bdc0ee34-4404-4862-a0eb-122ad024e617 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:04.902508 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bdc0ee34-4404-4862-a0eb-122ad024e617 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:04.902954 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bdc0ee34-4404-4862-a0eb-122ad024e617 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:04.904449 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bdc0ee34-4404-4862-a0eb-122ad024e617 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:04.904831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bdc0ee34-4404-4862-a0eb-122ad024e617 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:05.051676 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-bdc0ee34-4404-4862-a0eb-122ad024e617 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:05.059978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-bdc0ee34-4404-4862-a0eb-122ad024e617 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1700 microversion: 2.1 time: 0.168561 Dec 15 13:42:05.060548 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 390/787] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:04 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1700 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:05.077447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-03691501-065a-434e-9505-7c9343c33512 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:05.083804 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03691501-065a-434e-9505-7c9343c33512 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:05.084247 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-03691501-065a-434e-9505-7c9343c33512 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:05.107387 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-03691501-065a-434e-9505-7c9343c33512 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Going to try to start instance {{(pid=122611) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 13:42:05.149593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-03691501-065a-434e-9505-7c9343c33512 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 202 len: 0 microversion: 2.1 time: 0.076611 Dec 15 13:42:05.150301 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 398/788] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:42:05 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:42:05.159923 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-999fb0f5-d71a-4b84-a550-afd2ecb8a61e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:05.160435 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-999fb0f5-d71a-4b84-a550-afd2ecb8a61e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:05.166632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-999fb0f5-d71a-4b84-a550-afd2ecb8a61e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:05.167279 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-999fb0f5-d71a-4b84-a550-afd2ecb8a61e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:05.168176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-999fb0f5-d71a-4b84-a550-afd2ecb8a61e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:05.169134 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-999fb0f5-d71a-4b84-a550-afd2ecb8a61e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:05.330632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-999fb0f5-d71a-4b84-a550-afd2ecb8a61e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:05.338562 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-999fb0f5-d71a-4b84-a550-afd2ecb8a61e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1709 microversion: 2.1 time: 0.183172 Dec 15 13:42:05.339134 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 391/789] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:05 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1709 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:05.564409 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:05.565130 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:05.574693 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:05.575235 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:05.576052 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:05.576514 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:05.703506 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-7cfc0e87-e8ef-4976-aea2-5b11872b98c6 req-d7d1a157-5961-4c8c-97ca-26bc77d46032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8832f44d-71e8-44e3-b955-88a3285a3cb2", "name": "network-vif-unplugged", "status": "completed", "tag": "eb6d9258-9d98-4855-ac93-8388249d6cd9"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:05.705444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:05.705444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:42:05.714452 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-7cfc0e87-e8ef-4976-aea2-5b11872b98c6 req-d7d1a157-5961-4c8c-97ca-26bc77d46032 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:05.714983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-7cfc0e87-e8ef-4976-aea2-5b11872b98c6 req-d7d1a157-5961-4c8c-97ca-26bc77d46032 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:05.729806 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.compute.server_external_events [req-7cfc0e87-e8ef-4976-aea2-5b11872b98c6 req-d7d1a157-5961-4c8c-97ca-26bc77d46032 service nova] Unable to find a host for instance 8832f44d-71e8-44e3-b955-88a3285a3cb2. Dropping event network-vif-unplugged {{(pid=122612) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 13:42:05.731026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-7cfc0e87-e8ef-4976-aea2-5b11872b98c6 req-d7d1a157-5961-4c8c-97ca-26bc77d46032 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.106199 Dec 15 13:42:05.732373 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 392/790] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:05 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 15 13:42:05.839803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:05.847812 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:05.849384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:05.850897 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2b63f288-a533-4ffa-9661-6ea18c86aa58 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1666 microversion: 2.20 time: 0.292400 Dec 15 13:42:05.851534 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 399/791] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:05 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1666 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:05.869190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d336f04f-2160-4273-8386-f28a3869ac37 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6323216a-e325-4634-ae21-22ac73e6d5e3"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:05.870326 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d336f04f-2160-4273-8386-f28a3869ac37 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:05.876753 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d336f04f-2160-4273-8386-f28a3869ac37 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:05.877200 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d336f04f-2160-4273-8386-f28a3869ac37 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:05.878001 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d336f04f-2160-4273-8386-f28a3869ac37 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:05.878426 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d336f04f-2160-4273-8386-f28a3869ac37 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.137280 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d336f04f-2160-4273-8386-f28a3869ac37 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.271768 Dec 15 13:42:06.137948 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 393/792] 10.222.0.83 () {62 vars in 1363 bytes} [Wed Dec 15 13:42:05 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/os-volume_attachments => generated 188 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:42:06.249428 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f32129cd-9bcc-444a-bb16-db6a516a843f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:06.250081 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f32129cd-9bcc-444a-bb16-db6a516a843f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:06.255894 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f32129cd-9bcc-444a-bb16-db6a516a843f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:06.256341 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f32129cd-9bcc-444a-bb16-db6a516a843f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.257118 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f32129cd-9bcc-444a-bb16-db6a516a843f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:06.257556 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f32129cd-9bcc-444a-bb16-db6a516a843f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.355633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-12a92df5-08fd-425d-9eba-d3e744d6d1e6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:06.356629 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-12a92df5-08fd-425d-9eba-d3e744d6d1e6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:06.362549 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12a92df5-08fd-425d-9eba-d3e744d6d1e6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:06.363068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12a92df5-08fd-425d-9eba-d3e744d6d1e6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.363917 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12a92df5-08fd-425d-9eba-d3e744d6d1e6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:06.364475 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-12a92df5-08fd-425d-9eba-d3e744d6d1e6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.509653 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-12a92df5-08fd-425d-9eba-d3e744d6d1e6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:06.518998 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-12a92df5-08fd-425d-9eba-d3e744d6d1e6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1709 microversion: 2.1 time: 0.166522 Dec 15 13:42:06.519742 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 394/793] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:06 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:06.546899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f32129cd-9bcc-444a-bb16-db6a516a843f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/os-volume_attachments/6323216a-e325-4634-ae21-22ac73e6d5e3" status: 202 len: 0 microversion: 2.20 time: 0.301030 Dec 15 13:42:06.547541 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 400/794] 10.222.0.83 () {60 vars in 1456 bytes} [Wed Dec 15 13:42:06 2021] DELETE /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/os-volume_attachments/6323216a-e325-4634-ae21-22ac73e6d5e3 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:42:06.606674 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-bf2264f0-3620-4cfa-ba5e-ef39ea4a23da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:06.607281 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-bf2264f0-3620-4cfa-ba5e-ef39ea4a23da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:06.613037 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bf2264f0-3620-4cfa-ba5e-ef39ea4a23da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:06.613482 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bf2264f0-3620-4cfa-ba5e-ef39ea4a23da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.614281 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bf2264f0-3620-4cfa-ba5e-ef39ea4a23da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:06.614716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-bf2264f0-3620-4cfa-ba5e-ef39ea4a23da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.692620 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-bf2264f0-3620-4cfa-ba5e-ef39ea4a23da tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action" status: 202 len: 0 microversion: 2.20 time: 0.089427 Dec 15 13:42:06.693234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 395/795] 10.222.0.83 () {62 vars in 1318 bytes} [Wed Dec 15 13:42:06 2021] POST /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:42:06.701061 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:06.701659 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:06.708323 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:06.708765 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.709543 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:06.709989 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:06.848599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:06.856620 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:06.858264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:06.859429 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f4f82f85-808b-4a00-ba5e-d2055b8093c9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1674 microversion: 2.20 time: 0.162104 Dec 15 13:42:06.859998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 401/796] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:06 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:07.536728 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4a2a1aa0-5b4c-4880-a7ca-1ab941abfbc2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:07.537286 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4a2a1aa0-5b4c-4880-a7ca-1ab941abfbc2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:07.545303 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a2a1aa0-5b4c-4880-a7ca-1ab941abfbc2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:07.545775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a2a1aa0-5b4c-4880-a7ca-1ab941abfbc2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:07.546568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a2a1aa0-5b4c-4880-a7ca-1ab941abfbc2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:07.547005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a2a1aa0-5b4c-4880-a7ca-1ab941abfbc2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:07.686095 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4a2a1aa0-5b4c-4880-a7ca-1ab941abfbc2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:07.693906 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4a2a1aa0-5b4c-4880-a7ca-1ab941abfbc2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1713 microversion: 2.1 time: 0.161113 Dec 15 13:42:07.694487 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 396/797] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:07 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1713 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:07.878219 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:07.879102 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:07.885639 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:07.886166 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:07.886984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:07.887424 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:08.017897 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:08.025606 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:08.027140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:08.028294 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d267a8b5-6b49-45b3-be75-cc091814749c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.153972 Dec 15 13:42:08.028883 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 402/798] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:07 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:09.048850 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:09.049817 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:09.056513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:09.057109 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:09.059681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:09.060268 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:09.256832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:09.267134 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:09.269114 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:09.270617 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8bdedf9e-e749-4c14-a64f-819aadbac64c tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.226640 Dec 15 13:42:09.271495 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 397/799] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:09 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:09.927326 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-999e9248-f3a7-4e06-859b-c0f120017e7b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:09.928862 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-999e9248-f3a7-4e06-859b-c0f120017e7b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:09.936888 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-999e9248-f3a7-4e06-859b-c0f120017e7b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:09.937695 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-999e9248-f3a7-4e06-859b-c0f120017e7b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:09.938777 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-999e9248-f3a7-4e06-859b-c0f120017e7b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:09.939449 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-999e9248-f3a7-4e06-859b-c0f120017e7b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:09.965882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-999e9248-f3a7-4e06-859b-c0f120017e7b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lazy-loading 'flavor' on Instance uuid 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:42:10.043780 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-999e9248-f3a7-4e06-859b-c0f120017e7b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "POST /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6/action" status: 202 len: 0 microversion: 2.1 time: 0.128519 Dec 15 13:42:10.044357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 403/800] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:42:09 2021] POST /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:42:10.052467 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d89d26b3-d920-4d86-8391-92056404e45f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:10.053076 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d89d26b3-d920-4d86-8391-92056404e45f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:10.059709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d89d26b3-d920-4d86-8391-92056404e45f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:10.060158 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d89d26b3-d920-4d86-8391-92056404e45f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:10.060950 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d89d26b3-d920-4d86-8391-92056404e45f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:10.061386 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d89d26b3-d920-4d86-8391-92056404e45f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:10.217356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-d89d26b3-d920-4d86-8391-92056404e45f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:10.225084 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d89d26b3-d920-4d86-8391-92056404e45f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.176232 Dec 15 13:42:10.225953 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 398/801] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:10 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:10.290994 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:10.291694 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:10.298224 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:10.298673 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:10.299452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:10.299889 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:10.466358 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:10.475838 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:10.477418 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:10.478774 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e28ce0cc-9d00-4f1f-a4f5-a7992cced71b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.191778 Dec 15 13:42:10.479589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 404/802] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:10 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:11.242395 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-502d6e17-559f-4720-8789-9dd3def21d78 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:11.242998 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-502d6e17-559f-4720-8789-9dd3def21d78 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:11.249237 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-502d6e17-559f-4720-8789-9dd3def21d78 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:11.249689 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-502d6e17-559f-4720-8789-9dd3def21d78 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:11.250562 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-502d6e17-559f-4720-8789-9dd3def21d78 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:11.250999 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-502d6e17-559f-4720-8789-9dd3def21d78 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:11.402712 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-502d6e17-559f-4720-8789-9dd3def21d78 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:11.411524 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-502d6e17-559f-4720-8789-9dd3def21d78 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.172673 Dec 15 13:42:11.412120 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 399/803] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:11 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:11.497841 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:11.498408 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:11.504626 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:11.505070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:11.506029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:11.506491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:11.652889 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:11.662473 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:11.663995 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:11.665153 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-06af4847-404a-4e3c-b694-c9d7ca331717 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.171121 Dec 15 13:42:11.665706 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 405/804] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:11 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:12.428492 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-117fdd46-94c4-4f04-8c1b-f1044fab6e79 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:12.429085 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-117fdd46-94c4-4f04-8c1b-f1044fab6e79 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:12.436135 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-117fdd46-94c4-4f04-8c1b-f1044fab6e79 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:12.436577 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-117fdd46-94c4-4f04-8c1b-f1044fab6e79 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:12.437358 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-117fdd46-94c4-4f04-8c1b-f1044fab6e79 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:12.437992 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-117fdd46-94c4-4f04-8c1b-f1044fab6e79 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:12.575704 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-117fdd46-94c4-4f04-8c1b-f1044fab6e79 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:12.587364 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-117fdd46-94c4-4f04-8c1b-f1044fab6e79 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.162356 Dec 15 13:42:12.588290 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 400/805] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:12 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:12.683283 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:12.683925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:12.691653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:12.692150 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:12.692949 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:12.693384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:12.852741 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:12.862100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:12.863568 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:12.864783 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4aa07565-d241-4618-9984-7edd5321777e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.185441 Dec 15 13:42:12.865380 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 406/806] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:12 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:13.605978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-13057fe6-0fb9-4d1c-9007-575628b9fb3a tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:13.606613 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-13057fe6-0fb9-4d1c-9007-575628b9fb3a tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:13.615022 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-13057fe6-0fb9-4d1c-9007-575628b9fb3a tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:13.615618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-13057fe6-0fb9-4d1c-9007-575628b9fb3a tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:13.616417 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-13057fe6-0fb9-4d1c-9007-575628b9fb3a tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:13.616849 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-13057fe6-0fb9-4d1c-9007-575628b9fb3a tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:13.751239 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-13057fe6-0fb9-4d1c-9007-575628b9fb3a tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:13.758522 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-13057fe6-0fb9-4d1c-9007-575628b9fb3a tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.156709 Dec 15 13:42:13.759070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 401/807] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:13 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:13.884886 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:13.886449 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:13.896362 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:13.896939 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:13.897922 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:13.898430 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:14.045725 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:14.053631 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:14.055126 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:14.056256 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1665b7d5-bec5-49fc-be89-e7e14ee63aa1 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.176288 Dec 15 13:42:14.056794 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 407/808] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:13 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:14.777181 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-89d2dfa7-0ec1-425b-a13e-e03169f96d1f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:14.779804 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-89d2dfa7-0ec1-425b-a13e-e03169f96d1f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:14.787306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-89d2dfa7-0ec1-425b-a13e-e03169f96d1f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:14.787754 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-89d2dfa7-0ec1-425b-a13e-e03169f96d1f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:14.788568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-89d2dfa7-0ec1-425b-a13e-e03169f96d1f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:14.789048 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-89d2dfa7-0ec1-425b-a13e-e03169f96d1f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:14.925510 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-89d2dfa7-0ec1-425b-a13e-e03169f96d1f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:14.932744 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-89d2dfa7-0ec1-425b-a13e-e03169f96d1f tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.160228 Dec 15 13:42:14.933302 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 402/809] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:14 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:15.075272 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:15.075891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:15.082743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:15.083188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:15.083956 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:15.084386 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:15.225574 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:15.236109 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:15.237639 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:15.238816 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d736b663-302d-42a5-9c0b-afd6bc898865 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.167372 Dec 15 13:42:15.239364 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 408/810] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:15 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:15.951928 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6bdec444-05d5-4828-b53b-d4824359ac21 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:15.952530 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6bdec444-05d5-4828-b53b-d4824359ac21 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:15.958856 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6bdec444-05d5-4828-b53b-d4824359ac21 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:15.959299 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6bdec444-05d5-4828-b53b-d4824359ac21 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:15.960079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6bdec444-05d5-4828-b53b-d4824359ac21 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:15.960512 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6bdec444-05d5-4828-b53b-d4824359ac21 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:16.095288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6bdec444-05d5-4828-b53b-d4824359ac21 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:16.102630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6bdec444-05d5-4828-b53b-d4824359ac21 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.155471 Dec 15 13:42:16.103185 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 403/811] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:15 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:16.256552 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:16.257116 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:16.263205 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:16.263654 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:16.264424 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:16.264858 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:16.402793 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:16.415287 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:16.416841 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:16.418090 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-09cbcc83-4aba-4db7-b17c-70e07250fc2e tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.165469 Dec 15 13:42:16.418685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 409/812] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:16 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:17.120218 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c0d2da8b-2b2e-43a0-a237-40c80c6d5624 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:17.120838 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c0d2da8b-2b2e-43a0-a237-40c80c6d5624 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:17.127364 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c0d2da8b-2b2e-43a0-a237-40c80c6d5624 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:17.127811 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c0d2da8b-2b2e-43a0-a237-40c80c6d5624 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:17.128595 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c0d2da8b-2b2e-43a0-a237-40c80c6d5624 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:17.129027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c0d2da8b-2b2e-43a0-a237-40c80c6d5624 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:17.259076 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c0d2da8b-2b2e-43a0-a237-40c80c6d5624 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:17.266341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c0d2da8b-2b2e-43a0-a237-40c80c6d5624 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.150112 Dec 15 13:42:17.266899 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 404/813] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:17 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:17.437280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:17.437888 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:17.444106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:17.444552 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:17.445324 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:17.445775 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:17.586519 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:17.596871 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:17.598456 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:17.599704 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7d6f00ef-8a50-4c50-9ebe-04bee6277d8b tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.166149 Dec 15 13:42:17.600331 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 410/814] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:17 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:18.283226 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cd21687e-84ee-4ebf-af4f-0f596b14dc76 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:18.283826 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cd21687e-84ee-4ebf-af4f-0f596b14dc76 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:18.290022 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd21687e-84ee-4ebf-af4f-0f596b14dc76 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:18.290471 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd21687e-84ee-4ebf-af4f-0f596b14dc76 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:18.291249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd21687e-84ee-4ebf-af4f-0f596b14dc76 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:18.291678 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd21687e-84ee-4ebf-af4f-0f596b14dc76 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:18.423415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cd21687e-84ee-4ebf-af4f-0f596b14dc76 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:18.433937 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cd21687e-84ee-4ebf-af4f-0f596b14dc76 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.154145 Dec 15 13:42:18.442702 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 405/815] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:18 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:18.625004 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:18.626332 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:18.632101 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:18.632623 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:18.633404 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:18.633935 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:18.783106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:18.791318 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:18.792851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:18.794053 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-293f40de-7cb2-408f-b8ea-89275f64de44 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.173438 Dec 15 13:42:18.799269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 411/816] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:18 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:19.452318 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e4ef22ef-46c9-47bc-8619-95d641ffe135 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:19.452974 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e4ef22ef-46c9-47bc-8619-95d641ffe135 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:19.459166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e4ef22ef-46c9-47bc-8619-95d641ffe135 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:19.459613 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e4ef22ef-46c9-47bc-8619-95d641ffe135 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:19.460428 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e4ef22ef-46c9-47bc-8619-95d641ffe135 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:19.460849 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e4ef22ef-46c9-47bc-8619-95d641ffe135 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:19.603256 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e4ef22ef-46c9-47bc-8619-95d641ffe135 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:19.610701 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e4ef22ef-46c9-47bc-8619-95d641ffe135 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.162639 Dec 15 13:42:19.611295 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 406/817] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:19 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:19.812841 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:19.813421 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:19.819641 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:19.820088 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:19.820851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:19.821310 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:19.979562 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:19.987371 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:19.988855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:19.990029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-57124877-6eae-49c3-95e6-3b00a157a625 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.181049 Dec 15 13:42:19.990615 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 412/818] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:19 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:20.629634 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-28332513-91fb-476e-a5c0-3806e2c6a0a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:20.630297 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-28332513-91fb-476e-a5c0-3806e2c6a0a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:20.638144 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-28332513-91fb-476e-a5c0-3806e2c6a0a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:20.638596 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-28332513-91fb-476e-a5c0-3806e2c6a0a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:20.639667 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-28332513-91fb-476e-a5c0-3806e2c6a0a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:20.640102 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-28332513-91fb-476e-a5c0-3806e2c6a0a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:20.768650 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-28332513-91fb-476e-a5c0-3806e2c6a0a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:20.775941 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-28332513-91fb-476e-a5c0-3806e2c6a0a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.151016 Dec 15 13:42:20.776501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 407/819] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:20 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:21.008890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:21.009424 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:21.016670 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:21.017122 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:21.017956 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:21.018394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:21.150214 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:21.157945 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:21.159429 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:21.160593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3d23219e-d205-4b0f-8387-c19b6c840dd9 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.155735 Dec 15 13:42:21.172017 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 413/820] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:21 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:21.792100 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8d91074e-4822-4ece-845e-6a163cfc45a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:21.792690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8d91074e-4822-4ece-845e-6a163cfc45a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:21.799494 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8d91074e-4822-4ece-845e-6a163cfc45a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:21.799933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8d91074e-4822-4ece-845e-6a163cfc45a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:21.800697 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8d91074e-4822-4ece-845e-6a163cfc45a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:21.801123 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8d91074e-4822-4ece-845e-6a163cfc45a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:21.931864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8d91074e-4822-4ece-845e-6a163cfc45a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:21.939180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8d91074e-4822-4ece-845e-6a163cfc45a3 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.150722 Dec 15 13:42:21.939742 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 408/821] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:21 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:22.179450 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:22.179980 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:22.186181 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:22.186622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:22.187381 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:22.187808 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:22.319211 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:22.327384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:22.328884 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:22.330047 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5001b263-d067-4166-8f35-d335199b7db0 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.154365 Dec 15 13:42:22.330599 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 414/822] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:22 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:22.956165 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8aab79db-010e-43d3-8e96-ab9af6ea6f97 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:22.956686 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8aab79db-010e-43d3-8e96-ab9af6ea6f97 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:22.962870 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8aab79db-010e-43d3-8e96-ab9af6ea6f97 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:22.963570 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8aab79db-010e-43d3-8e96-ab9af6ea6f97 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:22.964343 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8aab79db-010e-43d3-8e96-ab9af6ea6f97 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:22.964773 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8aab79db-010e-43d3-8e96-ab9af6ea6f97 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:23.096349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8aab79db-010e-43d3-8e96-ab9af6ea6f97 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:23.103551 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8aab79db-010e-43d3-8e96-ab9af6ea6f97 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.151142 Dec 15 13:42:23.104128 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 409/823] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:22 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:23.348471 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:23.348993 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:23.355225 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:23.355666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:23.356423 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:23.356851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:23.483239 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:23.490896 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:23.492390 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:23.493533 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2acf831f-d6ec-463c-9414-96da7546caff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.148883 Dec 15 13:42:23.494140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 415/824] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:23 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:42:24.121284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-97c65353-b23a-4f78-a4e9-0b84f0a30cbb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:24.121956 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-97c65353-b23a-4f78-a4e9-0b84f0a30cbb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:24.128778 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-97c65353-b23a-4f78-a4e9-0b84f0a30cbb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:24.129216 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-97c65353-b23a-4f78-a4e9-0b84f0a30cbb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:24.130044 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-97c65353-b23a-4f78-a4e9-0b84f0a30cbb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:24.130573 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-97c65353-b23a-4f78-a4e9-0b84f0a30cbb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:24.261224 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-97c65353-b23a-4f78-a4e9-0b84f0a30cbb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:24.271397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-97c65353-b23a-4f78-a4e9-0b84f0a30cbb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.153725 Dec 15 13:42:24.272423 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 410/825] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:24 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:24.511743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:24.512305 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:24.519269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:24.519716 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:24.520490 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:24.520927 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:24.656656 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:24.664550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:24.666052 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:24.667188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-23b1f64c-f4be-4d62-aea2-3664178d2de7 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.159259 Dec 15 13:42:24.667731 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 416/826] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:24 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:25.291652 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e3d49f94-67a1-41fe-8ccb-ce6389d7cb33 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:25.292237 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e3d49f94-67a1-41fe-8ccb-ce6389d7cb33 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:25.298921 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d49f94-67a1-41fe-8ccb-ce6389d7cb33 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:25.299362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d49f94-67a1-41fe-8ccb-ce6389d7cb33 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:25.300122 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d49f94-67a1-41fe-8ccb-ce6389d7cb33 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:25.300547 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d49f94-67a1-41fe-8ccb-ce6389d7cb33 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:25.429248 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e3d49f94-67a1-41fe-8ccb-ce6389d7cb33 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:25.436553 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e3d49f94-67a1-41fe-8ccb-ce6389d7cb33 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.148524 Dec 15 13:42:25.437106 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 411/827] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:25 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:25.459366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-55985e46-17fd-4d4b-a687-4416d9030347 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1827285349"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:25.459889 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-55985e46-17fd-4d4b-a687-4416d9030347 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:25.466092 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-55985e46-17fd-4d4b-a687-4416d9030347 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:25.467710 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-55985e46-17fd-4d4b-a687-4416d9030347 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:25.467899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-55985e46-17fd-4d4b-a687-4416d9030347 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:25.468332 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-55985e46-17fd-4d4b-a687-4416d9030347 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:25.595342 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.network.security_group_api [None req-55985e46-17fd-4d4b-a687-4416d9030347 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Removing security group 1b1801e8-b446-414a-b87d-240ff8a78350 from port 8387272b-2814-444a-bddf-6d072a131977 Dec 15 13:42:25.684749 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:25.686312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:25.693166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:25.693864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:25.695027 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:25.695656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:25.912941 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:25.921511 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:25.923121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:25.924371 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7bed9bee-b9ad-493b-948a-2735a1f3f5f3 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.243754 Dec 15 13:42:25.925000 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 412/828] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:25 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 13:42:25.929570 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-91ab303e-933c-41ec-a09e-e2771c20d042 req-c065ba91-1c91-4299-9776-77438b1495e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8832f44d-71e8-44e3-b955-88a3285a3cb2", "name": "network-vif-plugged", "status": "completed", "tag": "eb6d9258-9d98-4855-ac93-8388249d6cd9"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:25.931127 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:25.931127 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:42:25.938673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-91ab303e-933c-41ec-a09e-e2771c20d042 req-c065ba91-1c91-4299-9776-77438b1495e3 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:25.939396 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-91ab303e-933c-41ec-a09e-e2771c20d042 req-c065ba91-1c91-4299-9776-77438b1495e3 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:25.949787 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-91ab303e-933c-41ec-a09e-e2771c20d042 req-c065ba91-1c91-4299-9776-77438b1495e3 service nova] Creating event network-vif-plugged:eb6d9258-9d98-4855-ac93-8388249d6cd9 for instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 on hv-cinder-81322 Dec 15 13:42:25.954804 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-91ab303e-933c-41ec-a09e-e2771c20d042 req-c065ba91-1c91-4299-9776-77438b1495e3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028536 Dec 15 13:42:25.955396 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 413/829] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:26.010804 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-55985e46-17fd-4d4b-a687-4416d9030347 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "POST /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/action" status: 202 len: 0 microversion: 2.1 time: 0.555058 Dec 15 13:42:26.011405 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 417/830] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:42:25 2021] POST /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:42:26.150967 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-3e69ae74-928f-42d3-8ccd-bdb32fa9ba86 req-1bc6bfdd-a666-4eb4-a71f-4f691f8c8f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc679789-d368-43f8-ae73-af016defaac9", "tag": "8387272b-2814-444a-bddf-6d072a131977"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:26.153087 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:26.153087 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:42:26.163138 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-3e69ae74-928f-42d3-8ccd-bdb32fa9ba86 req-1bc6bfdd-a666-4eb4-a71f-4f691f8c8f3e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:26.163587 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-3e69ae74-928f-42d3-8ccd-bdb32fa9ba86 req-1bc6bfdd-a666-4eb4-a71f-4f691f8c8f3e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:26.178601 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-3e69ae74-928f-42d3-8ccd-bdb32fa9ba86 req-1bc6bfdd-a666-4eb4-a71f-4f691f8c8f3e service nova] Creating event network-changed:8387272b-2814-444a-bddf-6d072a131977 for instance cc679789-d368-43f8-ae73-af016defaac9 on hv-cinder-81322 Dec 15 13:42:26.202364 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-3e69ae74-928f-42d3-8ccd-bdb32fa9ba86 req-1bc6bfdd-a666-4eb4-a71f-4f691f8c8f3e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180135 Dec 15 13:42:26.203281 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 414/831] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:26.453292 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a3e2f2e2-fa24-498c-abd5-e97afbd8a174 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:26.453937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a3e2f2e2-fa24-498c-abd5-e97afbd8a174 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:26.459932 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a3e2f2e2-fa24-498c-abd5-e97afbd8a174 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:26.460378 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a3e2f2e2-fa24-498c-abd5-e97afbd8a174 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:26.461163 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a3e2f2e2-fa24-498c-abd5-e97afbd8a174 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:26.461593 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a3e2f2e2-fa24-498c-abd5-e97afbd8a174 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:26.683803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a3e2f2e2-fa24-498c-abd5-e97afbd8a174 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:26.693951 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a3e2f2e2-fa24-498c-abd5-e97afbd8a174 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.244305 Dec 15 13:42:26.694612 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 418/832] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:26 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:26.943502 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:26.944116 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:26.950836 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:26.951213 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:26.952014 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:26.952451 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.181638 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:27.189439 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:27.190996 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:27.192143 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-077bd8fc-b5ff-43cc-a162-4e6c28d50f8a tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.253315 Dec 15 13:42:27.192697 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 415/833] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:26 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:27.595552 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f99b53f0-50fb-4765-84dc-f56724cc5922 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:27.596523 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f99b53f0-50fb-4765-84dc-f56724cc5922 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:27.604121 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f99b53f0-50fb-4765-84dc-f56724cc5922 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:27.604736 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f99b53f0-50fb-4765-84dc-f56724cc5922 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.605621 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f99b53f0-50fb-4765-84dc-f56724cc5922 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:27.606164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f99b53f0-50fb-4765-84dc-f56724cc5922 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.704538 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-f99b53f0-50fb-4765-84dc-f56724cc5922 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lazy-loading 'services' on Instance uuid cc679789-d368-43f8-ae73-af016defaac9 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:42:27.713094 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ee20ddc3-f970-4bcd-ac42-371ccb139f89 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:27.714200 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ee20ddc3-f970-4bcd-ac42-371ccb139f89 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:27.733619 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee20ddc3-f970-4bcd-ac42-371ccb139f89 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:27.735092 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee20ddc3-f970-4bcd-ac42-371ccb139f89 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.736583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee20ddc3-f970-4bcd-ac42-371ccb139f89 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:27.737221 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ee20ddc3-f970-4bcd-ac42-371ccb139f89 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.844803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f99b53f0-50fb-4765-84dc-f56724cc5922 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "DELETE /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments/4455d95a-6ebe-4f54-9c23-fcaebccf53fe" status: 202 len: 0 microversion: 2.1 time: 0.253735 Dec 15 13:42:27.845430 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 419/834] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:42:27 2021] DELETE /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments/4455d95a-6ebe-4f54-9c23-fcaebccf53fe => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:42:27.860929 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-20e0c3f7-8591-4712-91a5-dd0ce3ac7082 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:27.862872 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-20e0c3f7-8591-4712-91a5-dd0ce3ac7082 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:27.874004 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-20e0c3f7-8591-4712-91a5-dd0ce3ac7082 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:27.874471 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-20e0c3f7-8591-4712-91a5-dd0ce3ac7082 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.875663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-20e0c3f7-8591-4712-91a5-dd0ce3ac7082 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:27.891627 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-20e0c3f7-8591-4712-91a5-dd0ce3ac7082 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:27.934875 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ee20ddc3-f970-4bcd-ac42-371ccb139f89 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:27.947960 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ee20ddc3-f970-4bcd-ac42-371ccb139f89 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.239327 Dec 15 13:42:27.950258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 416/835] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:27 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:27.963140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-20e0c3f7-8591-4712-91a5-dd0ce3ac7082 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110601 Dec 15 13:42:27.967383 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 420/836] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:42:27 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:28.210514 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:28.211157 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:28.219324 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-9ac3b631-a780-423a-9ac8-c2d4970cc31e req-deff0c41-e693-4af8-b589-dd7119c4871a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc679789-d368-43f8-ae73-af016defaac9", "tag": "8387272b-2814-444a-bddf-6d072a131977"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:28.220811 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:28.220811 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:42:28.227418 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.227872 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:28.228663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.229095 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:28.238120 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-9ac3b631-a780-423a-9ac8-c2d4970cc31e req-deff0c41-e693-4af8-b589-dd7119c4871a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.238683 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-9ac3b631-a780-423a-9ac8-c2d4970cc31e req-deff0c41-e693-4af8-b589-dd7119c4871a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:28.261046 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-9ac3b631-a780-423a-9ac8-c2d4970cc31e req-deff0c41-e693-4af8-b589-dd7119c4871a service nova] Creating event network-changed:8387272b-2814-444a-bddf-6d072a131977 for instance cc679789-d368-43f8-ae73-af016defaac9 on hv-cinder-81322 Dec 15 13:42:28.269128 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-9ac3b631-a780-423a-9ac8-c2d4970cc31e req-deff0c41-e693-4af8-b589-dd7119c4871a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053339 Dec 15 13:42:28.270595 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 421/837] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:28.390185 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:28.398561 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:28.400188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:28.401456 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-df808c47-52eb-4e4c-bbd0-bed39c02d825 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1732 microversion: 2.20 time: 0.194688 Dec 15 13:42:28.402599 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 417/838] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:28 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:28.969027 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-14e92d7e-b2e4-4e5d-a71b-6e212ab548fc tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:28.969923 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-14e92d7e-b2e4-4e5d-a71b-6e212ab548fc tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:28.974442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-87a63b19-a59f-4951-b4e5-fcad6b9b248e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:28.975410 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-87a63b19-a59f-4951-b4e5-fcad6b9b248e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:28.976923 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-14e92d7e-b2e4-4e5d-a71b-6e212ab548fc tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.977441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-14e92d7e-b2e4-4e5d-a71b-6e212ab548fc tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:28.978345 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-14e92d7e-b2e4-4e5d-a71b-6e212ab548fc tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.979021 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-14e92d7e-b2e4-4e5d-a71b-6e212ab548fc tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:28.987412 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-87a63b19-a59f-4951-b4e5-fcad6b9b248e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.987863 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-87a63b19-a59f-4951-b4e5-fcad6b9b248e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:28.988657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-87a63b19-a59f-4951-b4e5-fcad6b9b248e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:28.989270 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-87a63b19-a59f-4951-b4e5-fcad6b9b248e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:29.018570 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-87a63b19-a59f-4951-b4e5-fcad6b9b248e tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047981 Dec 15 13:42:29.019145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 418/839] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:42:28 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:42:29.028623 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:29.029255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:29.035169 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:29.035621 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:29.036408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:29.036848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:29.118190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] HTTP exception thrown: Instance cc679789-d368-43f8-ae73-af016defaac9 is not attached to volume 4455d95a-6ebe-4f54-9c23-fcaebccf53fe Dec 15 13:42:29.118788 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Returning 404 to user: Instance cc679789-d368-43f8-ae73-af016defaac9 is not attached to volume 4455d95a-6ebe-4f54-9c23-fcaebccf53fe {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:42:29.119618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-167af263-dc42-4f12-b152-16ca25a99fa5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "DELETE /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments/4455d95a-6ebe-4f54-9c23-fcaebccf53fe" status: 404 len: 154 microversion: 2.1 time: 0.094869 Dec 15 13:42:29.120169 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 419/840] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:42:29 2021] DELETE /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9/os-volume_attachments/4455d95a-6ebe-4f54-9c23-fcaebccf53fe => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:42:29.132228 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-14e92d7e-b2e4-4e5d-a71b-6e212ab548fc tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:29.139803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-14e92d7e-b2e4-4e5d-a71b-6e212ab548fc tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.174798 Dec 15 13:42:29.140454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 422/841] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:28 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:29.421021 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:29.421614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:29.427607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:29.428059 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:29.428876 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:29.429309 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:29.556590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:29.564115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:29.565588 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:29.566746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-79301970-e0bd-4f92-9148-9f9e05253887 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1719 microversion: 2.20 time: 0.150111 Dec 15 13:42:29.567289 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 420/842] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:42:29 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:42:30.156688 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-61289903-dec1-4459-be55-374d713d2402 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:30.157219 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-61289903-dec1-4459-be55-374d713d2402 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:30.163554 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-61289903-dec1-4459-be55-374d713d2402 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:30.163993 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-61289903-dec1-4459-be55-374d713d2402 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:30.164754 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-61289903-dec1-4459-be55-374d713d2402 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:30.165185 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-61289903-dec1-4459-be55-374d713d2402 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:30.246929 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-34f6921a-3bcf-408a-a90f-b93760aeb3e0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:30.247313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-34f6921a-3bcf-408a-a90f-b93760aeb3e0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:30.254589 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34f6921a-3bcf-408a-a90f-b93760aeb3e0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:30.255527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34f6921a-3bcf-408a-a90f-b93760aeb3e0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:30.256337 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34f6921a-3bcf-408a-a90f-b93760aeb3e0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:30.256792 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34f6921a-3bcf-408a-a90f-b93760aeb3e0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:30.281493 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-34f6921a-3bcf-408a-a90f-b93760aeb3e0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:42:30.302963 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-61289903-dec1-4459-be55-374d713d2402 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:30.310243 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-61289903-dec1-4459-be55-374d713d2402 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.157288 Dec 15 13:42:30.311073 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 423/843] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:30 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:30.359043 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-34f6921a-3bcf-408a-a90f-b93760aeb3e0 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "DELETE /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 204 len: 0 microversion: 2.1 time: 0.115966 Dec 15 13:42:30.359648 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 421/844] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:42:30 2021] DELETE /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:42:30.367895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f29fb698-1b19-4596-bdc4-8fe5384bd9fe tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:30.368499 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f29fb698-1b19-4596-bdc4-8fe5384bd9fe tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:30.374797 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f29fb698-1b19-4596-bdc4-8fe5384bd9fe tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:30.375244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f29fb698-1b19-4596-bdc4-8fe5384bd9fe tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:30.376107 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f29fb698-1b19-4596-bdc4-8fe5384bd9fe tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:30.376637 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f29fb698-1b19-4596-bdc4-8fe5384bd9fe tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:30.511103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f29fb698-1b19-4596-bdc4-8fe5384bd9fe tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:30.519034 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f29fb698-1b19-4596-bdc4-8fe5384bd9fe tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1552 microversion: 2.1 time: 0.154728 Dec 15 13:42:30.519594 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 424/845] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:30 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:31.328608 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-63c6e101-4e45-49b0-83bc-df5c48e49556 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:31.329292 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-63c6e101-4e45-49b0-83bc-df5c48e49556 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:31.335682 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-63c6e101-4e45-49b0-83bc-df5c48e49556 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:31.336124 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-63c6e101-4e45-49b0-83bc-df5c48e49556 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:31.336897 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-63c6e101-4e45-49b0-83bc-df5c48e49556 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:31.337320 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-63c6e101-4e45-49b0-83bc-df5c48e49556 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:31.478529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-63c6e101-4e45-49b0-83bc-df5c48e49556 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:31.487209 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-63c6e101-4e45-49b0-83bc-df5c48e49556 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.162706 Dec 15 13:42:31.488021 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 422/846] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:31 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:31.536574 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8768d65d-6757-4b65-84f8-d6ef420cb422 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:31.538887 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8768d65d-6757-4b65-84f8-d6ef420cb422 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:31.544055 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8768d65d-6757-4b65-84f8-d6ef420cb422 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:31.544506 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8768d65d-6757-4b65-84f8-d6ef420cb422 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:31.546008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8768d65d-6757-4b65-84f8-d6ef420cb422 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:31.546577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8768d65d-6757-4b65-84f8-d6ef420cb422 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:31.688105 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-8768d65d-6757-4b65-84f8-d6ef420cb422 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:31.696924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8768d65d-6757-4b65-84f8-d6ef420cb422 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1552 microversion: 2.1 time: 0.163970 Dec 15 13:42:31.697514 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 425/847] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:31 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:32.504084 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-33cba0c8-b8d8-4c1d-bbd0-12054a30fe83 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:32.504692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-33cba0c8-b8d8-4c1d-bbd0-12054a30fe83 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:32.510981 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-33cba0c8-b8d8-4c1d-bbd0-12054a30fe83 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:32.511545 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-33cba0c8-b8d8-4c1d-bbd0-12054a30fe83 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:32.512396 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-33cba0c8-b8d8-4c1d-bbd0-12054a30fe83 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:32.512910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-33cba0c8-b8d8-4c1d-bbd0-12054a30fe83 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:32.648444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-33cba0c8-b8d8-4c1d-bbd0-12054a30fe83 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:32.655955 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-33cba0c8-b8d8-4c1d-bbd0-12054a30fe83 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.155646 Dec 15 13:42:32.656524 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 423/848] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:32 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:32.714277 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3eb0a6fc-0761-4c37-a12e-b817186943b5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:32.714893 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3eb0a6fc-0761-4c37-a12e-b817186943b5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:32.722133 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3eb0a6fc-0761-4c37-a12e-b817186943b5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:32.722664 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3eb0a6fc-0761-4c37-a12e-b817186943b5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:32.723532 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3eb0a6fc-0761-4c37-a12e-b817186943b5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:32.724039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3eb0a6fc-0761-4c37-a12e-b817186943b5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:32.790567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3eb0a6fc-0761-4c37-a12e-b817186943b5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a989a159d14d8099e2f9b5ee46f1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ce01ca50734f87ad8566b49ea5292a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:32.799403 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3eb0a6fc-0761-4c37-a12e-b817186943b5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 200 len: 1510 microversion: 2.1 time: 0.089226 Dec 15 13:42:32.799962 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 426/849] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:32 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:32.827939 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-4fefab8d-0aa1-496c-b0d3-1482d82f33be req-47812e30-86ad-42d5-9cbe-33f3fa1dd6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc679789-d368-43f8-ae73-af016defaac9", "name": "network-vif-deleted", "tag": "8387272b-2814-444a-bddf-6d072a131977"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:32.829606 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:32.829606 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:42:32.837682 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-4fefab8d-0aa1-496c-b0d3-1482d82f33be req-47812e30-86ad-42d5-9cbe-33f3fa1dd6d2 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:32.838285 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-4fefab8d-0aa1-496c-b0d3-1482d82f33be req-47812e30-86ad-42d5-9cbe-33f3fa1dd6d2 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:32.851468 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-4fefab8d-0aa1-496c-b0d3-1482d82f33be req-47812e30-86ad-42d5-9cbe-33f3fa1dd6d2 service nova] Creating event network-vif-deleted:8387272b-2814-444a-bddf-6d072a131977 for instance cc679789-d368-43f8-ae73-af016defaac9 on hv-cinder-81322 Dec 15 13:42:32.856544 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-4fefab8d-0aa1-496c-b0d3-1482d82f33be req-47812e30-86ad-42d5-9cbe-33f3fa1dd6d2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092598 Dec 15 13:42:32.857142 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 424/850] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:33.676352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a58bbcc6-dbfe-41e6-9e64-91f7311db8b6 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:33.676352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a58bbcc6-dbfe-41e6-9e64-91f7311db8b6 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:33.680997 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a58bbcc6-dbfe-41e6-9e64-91f7311db8b6 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:33.681445 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a58bbcc6-dbfe-41e6-9e64-91f7311db8b6 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:33.682260 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a58bbcc6-dbfe-41e6-9e64-91f7311db8b6 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:33.682690 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a58bbcc6-dbfe-41e6-9e64-91f7311db8b6 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:33.816566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:33.817253 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] [instance: cc679789-d368-43f8-ae73-af016defaac9] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:33.820496 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a58bbcc6-dbfe-41e6-9e64-91f7311db8b6 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:33.823540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:33.823986 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:33.824963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:33.825396 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:33.828891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a58bbcc6-dbfe-41e6-9e64-91f7311db8b6 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.158893 Dec 15 13:42:33.829470 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 427/851] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:33 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:33.838846 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] HTTP exception thrown: Instance cc679789-d368-43f8-ae73-af016defaac9 could not be found. Dec 15 13:42:33.839691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Returning 404 to user: Instance cc679789-d368-43f8-ae73-af016defaac9 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:42:33.840515 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cf0af4ff-ebfa-4dc8-922f-a056405f4ab5 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9" status: 404 len: 111 microversion: 2.1 time: 0.027963 Dec 15 13:42:33.844633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 425/852] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:33 2021] GET /compute/v2.1/servers/cc679789-d368-43f8-ae73-af016defaac9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:42:33.849484 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2ffc20c1-25d3-4025-a9c7-0db8ee02bfe6 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] Calling method '.version_select at 0x7fd79c048550>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:33.869038 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2ffc20c1-25d3-4025-a9c7-0db8ee02bfe6 tempest-TestMinimumBasicScenario-961960016 tempest-TestMinimumBasicScenario-961960016-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-51881202" status: 202 len: 0 microversion: 2.1 time: 0.023136 Dec 15 13:42:33.870181 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 428/853] 10.222.0.83 () {58 vars in 1265 bytes} [Wed Dec 15 13:42:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-51881202 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:42:34.846371 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2c72e31c-a401-4b64-8bed-f1032516536c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:34.847597 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2c72e31c-a401-4b64-8bed-f1032516536c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:34.853633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c72e31c-a401-4b64-8bed-f1032516536c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:34.854099 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c72e31c-a401-4b64-8bed-f1032516536c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:34.854882 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c72e31c-a401-4b64-8bed-f1032516536c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:34.855314 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c72e31c-a401-4b64-8bed-f1032516536c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:35.041963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2c72e31c-a401-4b64-8bed-f1032516536c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:35.050857 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2c72e31c-a401-4b64-8bed-f1032516536c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1510 microversion: 2.1 time: 0.208757 Dec 15 13:42:35.051436 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 426/854] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:34 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:35.073512 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7a6c1896-9e1e-4d52-8159-7867c3cc822c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:35.074576 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7a6c1896-9e1e-4d52-8159-7867c3cc822c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:35.084045 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7a6c1896-9e1e-4d52-8159-7867c3cc822c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:35.084498 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7a6c1896-9e1e-4d52-8159-7867c3cc822c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:35.085289 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7a6c1896-9e1e-4d52-8159-7867c3cc822c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:35.085726 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7a6c1896-9e1e-4d52-8159-7867c3cc822c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:35.267400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7a6c1896-9e1e-4d52-8159-7867c3cc822c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "POST /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6/action" status: 202 len: 0 microversion: 2.1 time: 0.200799 Dec 15 13:42:35.268279 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 429/855] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:42:35 2021] POST /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:42:35.284815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ed43f9de-3bca-4177-a907-2527259a5aeb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:35.285667 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ed43f9de-3bca-4177-a907-2527259a5aeb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:35.292955 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ed43f9de-3bca-4177-a907-2527259a5aeb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:35.293402 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ed43f9de-3bca-4177-a907-2527259a5aeb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:35.294560 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ed43f9de-3bca-4177-a907-2527259a5aeb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:35.295281 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ed43f9de-3bca-4177-a907-2527259a5aeb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:35.557604 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-ed43f9de-3bca-4177-a907-2527259a5aeb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:35.570648 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ed43f9de-3bca-4177-a907-2527259a5aeb tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1518 microversion: 2.1 time: 0.288260 Dec 15 13:42:35.572060 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 427/856] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:35 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1518 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:36.588729 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d69828cf-422f-4570-820b-cf4ad09c2e65 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:36.589587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d69828cf-422f-4570-820b-cf4ad09c2e65 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:36.598788 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d69828cf-422f-4570-820b-cf4ad09c2e65 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:36.599509 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d69828cf-422f-4570-820b-cf4ad09c2e65 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:36.600461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d69828cf-422f-4570-820b-cf4ad09c2e65 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:36.600896 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d69828cf-422f-4570-820b-cf4ad09c2e65 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:36.839422 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d69828cf-422f-4570-820b-cf4ad09c2e65 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:36.848182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d69828cf-422f-4570-820b-cf4ad09c2e65 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1576 microversion: 2.1 time: 0.263526 Dec 15 13:42:36.848751 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 430/857] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:36 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:37.847532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-6d0676e8-5ae5-4cbc-bf56-1b16302f4494 req-46c4c7ab-5020-463e-aae6-326d1a6215fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbd3cfd-7384-46fd-8231-1016f1c0cdc6", "name": "network-vif-unplugged", "status": "completed", "tag": "eb15e4a2-9577-4f05-b3d6-86804d162658"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:37.849573 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:37.849573 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:42:37.859207 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-6d0676e8-5ae5-4cbc-bf56-1b16302f4494 req-46c4c7ab-5020-463e-aae6-326d1a6215fd service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:37.860003 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-6d0676e8-5ae5-4cbc-bf56-1b16302f4494 req-46c4c7ab-5020-463e-aae6-326d1a6215fd service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:37.870456 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-613e1361-a4ce-41d2-94c3-85640cc09c60 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:37.872614 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-613e1361-a4ce-41d2-94c3-85640cc09c60 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:37.883161 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-613e1361-a4ce-41d2-94c3-85640cc09c60 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:37.883973 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-613e1361-a4ce-41d2-94c3-85640cc09c60 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:37.885014 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-613e1361-a4ce-41d2-94c3-85640cc09c60 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:37.885876 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-613e1361-a4ce-41d2-94c3-85640cc09c60 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:37.893427 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-6d0676e8-5ae5-4cbc-bf56-1b16302f4494 req-46c4c7ab-5020-463e-aae6-326d1a6215fd service nova] Creating event network-vif-unplugged:eb15e4a2-9577-4f05-b3d6-86804d162658 for instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 on hv-cinder-81322 Dec 15 13:42:37.899484 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-6d0676e8-5ae5-4cbc-bf56-1b16302f4494 req-46c4c7ab-5020-463e-aae6-326d1a6215fd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056220 Dec 15 13:42:37.901198 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 428/858] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:38.140835 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-613e1361-a4ce-41d2-94c3-85640cc09c60 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:38.156670 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-613e1361-a4ce-41d2-94c3-85640cc09c60 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1576 microversion: 2.1 time: 0.293606 Dec 15 13:42:38.157946 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 431/859] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:37 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1576 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:39.174936 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b35bb6eb-a7de-4041-bcb2-626e7b5aaf81 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:39.175610 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b35bb6eb-a7de-4041-bcb2-626e7b5aaf81 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:39.182377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b35bb6eb-a7de-4041-bcb2-626e7b5aaf81 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:39.182810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b35bb6eb-a7de-4041-bcb2-626e7b5aaf81 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:39.183594 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b35bb6eb-a7de-4041-bcb2-626e7b5aaf81 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:39.184020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b35bb6eb-a7de-4041-bcb2-626e7b5aaf81 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:39.325969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b35bb6eb-a7de-4041-bcb2-626e7b5aaf81 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:39.336427 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b35bb6eb-a7de-4041-bcb2-626e7b5aaf81 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1576 microversion: 2.1 time: 0.165504 Dec 15 13:42:39.337028 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 429/860] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:39 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:40.353891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-66de9be5-c99d-4276-8992-388b8d02c8b7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:40.355079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-66de9be5-c99d-4276-8992-388b8d02c8b7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:40.361869 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-66de9be5-c99d-4276-8992-388b8d02c8b7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:40.362592 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-66de9be5-c99d-4276-8992-388b8d02c8b7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:40.363376 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-66de9be5-c99d-4276-8992-388b8d02c8b7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:40.363808 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-66de9be5-c99d-4276-8992-388b8d02c8b7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:40.497640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-66de9be5-c99d-4276-8992-388b8d02c8b7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:40.516391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-66de9be5-c99d-4276-8992-388b8d02c8b7 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1576 microversion: 2.1 time: 0.165416 Dec 15 13:42:40.523423 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 432/861] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:40 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:41.534585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7927d831-b43a-4a9e-b4c7-e8845edd5c49 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:41.535193 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7927d831-b43a-4a9e-b4c7-e8845edd5c49 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:41.541258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7927d831-b43a-4a9e-b4c7-e8845edd5c49 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:41.541700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7927d831-b43a-4a9e-b4c7-e8845edd5c49 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:41.542517 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7927d831-b43a-4a9e-b4c7-e8845edd5c49 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:41.542949 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7927d831-b43a-4a9e-b4c7-e8845edd5c49 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:41.694558 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7927d831-b43a-4a9e-b4c7-e8845edd5c49 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:41.704029 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7927d831-b43a-4a9e-b4c7-e8845edd5c49 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1576 microversion: 2.1 time: 0.173204 Dec 15 13:42:41.704600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 430/862] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:41 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:42.721448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8ffd4882-f87e-4ea5-b661-3c5b938fc11e tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:42.722169 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8ffd4882-f87e-4ea5-b661-3c5b938fc11e tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:42.728790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8ffd4882-f87e-4ea5-b661-3c5b938fc11e tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:42.729245 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8ffd4882-f87e-4ea5-b661-3c5b938fc11e tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:42.730241 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8ffd4882-f87e-4ea5-b661-3c5b938fc11e tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:42.730682 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8ffd4882-f87e-4ea5-b661-3c5b938fc11e tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:42.872769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-8ffd4882-f87e-4ea5-b661-3c5b938fc11e tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:42.880647 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8ffd4882-f87e-4ea5-b661-3c5b938fc11e tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1576 microversion: 2.1 time: 0.163379 Dec 15 13:42:42.881217 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 433/863] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:42 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:43.117595 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-586b6993-4f1b-4405-b033-bb9fb719de6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:43.118166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-586b6993-4f1b-4405-b033-bb9fb719de6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:43.125040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-586b6993-4f1b-4405-b033-bb9fb719de6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:43.125469 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-586b6993-4f1b-4405-b033-bb9fb719de6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:43.126285 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-586b6993-4f1b-4405-b033-bb9fb719de6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:43.126724 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-586b6993-4f1b-4405-b033-bb9fb719de6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:43.207971 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-586b6993-4f1b-4405-b033-bb9fb719de6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lazy-loading 'services' on Instance uuid 09248873-3a26-46a0-bbd1-b3574f74bc7a {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:42:43.277211 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-586b6993-4f1b-4405-b033-bb9fb719de6f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/os-volume_attachments/96a6eda8-874a-4e36-9418-4c1da7e9ecb1" status: 202 len: 0 microversion: 2.1 time: 0.163211 Dec 15 13:42:43.277959 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 431/864] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:42:43 2021] DELETE /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/os-volume_attachments/96a6eda8-874a-4e36-9418-4c1da7e9ecb1 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:42:43.900711 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-88a9c671-5023-40b4-8180-fc708930b571 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:43.901341 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-88a9c671-5023-40b4-8180-fc708930b571 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:43.908669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-88a9c671-5023-40b4-8180-fc708930b571 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:43.909352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-88a9c671-5023-40b4-8180-fc708930b571 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:43.909848 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-88a9c671-5023-40b4-8180-fc708930b571 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:43.910290 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-88a9c671-5023-40b4-8180-fc708930b571 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:44.047341 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-88a9c671-5023-40b4-8180-fc708930b571 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:44.054910 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-88a9c671-5023-40b4-8180-fc708930b571 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1576 microversion: 2.1 time: 0.158008 Dec 15 13:42:44.055477 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 434/865] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:43 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:44.386576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-10b9fd5a-6699-450e-9445-0201fcee5ccc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:44.393392 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10b9fd5a-6699-450e-9445-0201fcee5ccc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:44.393929 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-10b9fd5a-6699-450e-9445-0201fcee5ccc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:44.453031 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-10b9fd5a-6699-450e-9445-0201fcee5ccc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Going to try to stop instance {{(pid=122612) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 13:42:44.496508 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-10b9fd5a-6699-450e-9445-0201fcee5ccc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 202 len: 0 microversion: 2.1 time: 0.114724 Dec 15 13:42:44.497023 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 432/866] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:42:44 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:42:44.505562 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-221f25e4-f091-4598-8885-8905609112a4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:44.506291 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-221f25e4-f091-4598-8885-8905609112a4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:44.512795 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-221f25e4-f091-4598-8885-8905609112a4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:44.513851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-221f25e4-f091-4598-8885-8905609112a4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:44.514079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-221f25e4-f091-4598-8885-8905609112a4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:44.515178 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-221f25e4-f091-4598-8885-8905609112a4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:44.649416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-221f25e4-f091-4598-8885-8905609112a4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:44.657550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-221f25e4-f091-4598-8885-8905609112a4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.155777 Dec 15 13:42:44.658177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 435/867] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:44 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:45.072578 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-62db5929-a345-4507-97f8-8bbf6ce3dc66 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:45.073297 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-62db5929-a345-4507-97f8-8bbf6ce3dc66 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:45.079454 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-62db5929-a345-4507-97f8-8bbf6ce3dc66 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:45.079905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-62db5929-a345-4507-97f8-8bbf6ce3dc66 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:45.080681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-62db5929-a345-4507-97f8-8bbf6ce3dc66 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:45.081109 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-62db5929-a345-4507-97f8-8bbf6ce3dc66 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:45.225614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-62db5929-a345-4507-97f8-8bbf6ce3dc66 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:45.233930 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-62db5929-a345-4507-97f8-8bbf6ce3dc66 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1563 microversion: 2.1 time: 0.164754 Dec 15 13:42:45.234503 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 433/868] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:45 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:45.676312 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0b5b67dc-2f6d-4c59-a78b-813e5845e9ad tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:45.676977 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0b5b67dc-2f6d-4c59-a78b-813e5845e9ad tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:45.683262 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b5b67dc-2f6d-4c59-a78b-813e5845e9ad tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:45.683710 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b5b67dc-2f6d-4c59-a78b-813e5845e9ad tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:45.684498 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b5b67dc-2f6d-4c59-a78b-813e5845e9ad tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:45.684931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0b5b67dc-2f6d-4c59-a78b-813e5845e9ad tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:45.823694 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0b5b67dc-2f6d-4c59-a78b-813e5845e9ad tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:45.831305 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0b5b67dc-2f6d-4c59-a78b-813e5845e9ad tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.158943 Dec 15 13:42:45.831895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 436/869] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:45 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:46.848268 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8819d1a6-c32f-4d8d-b230-f8566b687df3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:46.848870 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8819d1a6-c32f-4d8d-b230-f8566b687df3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:46.854663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8819d1a6-c32f-4d8d-b230-f8566b687df3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:46.855451 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8819d1a6-c32f-4d8d-b230-f8566b687df3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:46.856225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8819d1a6-c32f-4d8d-b230-f8566b687df3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:46.856656 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8819d1a6-c32f-4d8d-b230-f8566b687df3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:46.986465 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8819d1a6-c32f-4d8d-b230-f8566b687df3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:46.993622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8819d1a6-c32f-4d8d-b230-f8566b687df3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.149149 Dec 15 13:42:46.994201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 434/870] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:46 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:47.828032 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-95f62874-b007-4700-8c34-31e647d08d4f req-82760aaa-2e81-45e2-9d9a-3db1894f4081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbd3cfd-7384-46fd-8231-1016f1c0cdc6", "name": "network-vif-plugged", "status": "completed", "tag": "eb15e4a2-9577-4f05-b3d6-86804d162658"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:47.829661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:42:47.829661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:42:47.837321 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-95f62874-b007-4700-8c34-31e647d08d4f req-82760aaa-2e81-45e2-9d9a-3db1894f4081 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:47.837786 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-95f62874-b007-4700-8c34-31e647d08d4f req-82760aaa-2e81-45e2-9d9a-3db1894f4081 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:47.850155 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-95f62874-b007-4700-8c34-31e647d08d4f req-82760aaa-2e81-45e2-9d9a-3db1894f4081 service nova] Creating event network-vif-plugged:eb15e4a2-9577-4f05-b3d6-86804d162658 for instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 on hv-cinder-81322 Dec 15 13:42:47.854994 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-95f62874-b007-4700-8c34-31e647d08d4f req-82760aaa-2e81-45e2-9d9a-3db1894f4081 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030841 Dec 15 13:42:47.855763 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 437/871] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:42:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:42:48.010904 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-35aa7fdc-5d16-45d8-b5ed-d498071ebb21 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:48.011529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-35aa7fdc-5d16-45d8-b5ed-d498071ebb21 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:48.017806 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-35aa7fdc-5d16-45d8-b5ed-d498071ebb21 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:48.018258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-35aa7fdc-5d16-45d8-b5ed-d498071ebb21 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:48.019034 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-35aa7fdc-5d16-45d8-b5ed-d498071ebb21 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:48.019466 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-35aa7fdc-5d16-45d8-b5ed-d498071ebb21 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:48.149058 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-35aa7fdc-5d16-45d8-b5ed-d498071ebb21 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:48.156961 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-35aa7fdc-5d16-45d8-b5ed-d498071ebb21 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.149720 Dec 15 13:42:48.157582 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 435/872] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:48 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:49.174653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-432964b3-2c58-40d6-a63c-aa577a263259 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:49.175340 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-432964b3-2c58-40d6-a63c-aa577a263259 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:49.181719 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-432964b3-2c58-40d6-a63c-aa577a263259 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:49.182189 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-432964b3-2c58-40d6-a63c-aa577a263259 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:49.182952 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-432964b3-2c58-40d6-a63c-aa577a263259 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:49.183378 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-432964b3-2c58-40d6-a63c-aa577a263259 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:49.310132 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-432964b3-2c58-40d6-a63c-aa577a263259 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:49.317960 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-432964b3-2c58-40d6-a63c-aa577a263259 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.147709 Dec 15 13:42:49.318546 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 438/873] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:49 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:50.334328 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-60bd1968-a214-477b-8ff3-ec6c3a8b210c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:50.334874 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-60bd1968-a214-477b-8ff3-ec6c3a8b210c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:50.341501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-60bd1968-a214-477b-8ff3-ec6c3a8b210c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:50.342061 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-60bd1968-a214-477b-8ff3-ec6c3a8b210c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:50.343333 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-60bd1968-a214-477b-8ff3-ec6c3a8b210c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:50.343759 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-60bd1968-a214-477b-8ff3-ec6c3a8b210c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:50.474325 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-60bd1968-a214-477b-8ff3-ec6c3a8b210c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:50.481502 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-60bd1968-a214-477b-8ff3-ec6c3a8b210c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.151022 Dec 15 13:42:50.482088 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 436/874] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:50 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:51.499532 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-84e8ae58-408f-4d02-8236-ae43440de79c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:51.500118 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-84e8ae58-408f-4d02-8236-ae43440de79c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:51.506446 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-84e8ae58-408f-4d02-8236-ae43440de79c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:51.506891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-84e8ae58-408f-4d02-8236-ae43440de79c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:51.507665 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-84e8ae58-408f-4d02-8236-ae43440de79c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:51.508096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-84e8ae58-408f-4d02-8236-ae43440de79c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:51.638237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-84e8ae58-408f-4d02-8236-ae43440de79c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:51.646397 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-84e8ae58-408f-4d02-8236-ae43440de79c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.150571 Dec 15 13:42:51.646968 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 439/875] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:51 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:52.663052 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0a4c7d7b-dee0-4238-9b42-3e6ed762afbe tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:52.663708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0a4c7d7b-dee0-4238-9b42-3e6ed762afbe tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:52.670125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0a4c7d7b-dee0-4238-9b42-3e6ed762afbe tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:52.670616 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0a4c7d7b-dee0-4238-9b42-3e6ed762afbe tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:52.671390 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0a4c7d7b-dee0-4238-9b42-3e6ed762afbe tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:52.671873 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0a4c7d7b-dee0-4238-9b42-3e6ed762afbe tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:52.813955 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-0a4c7d7b-dee0-4238-9b42-3e6ed762afbe tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:52.821228 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0a4c7d7b-dee0-4238-9b42-3e6ed762afbe tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.162025 Dec 15 13:42:52.821805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 437/876] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:52 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:53.838752 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c5c15359-4fc6-4fb5-82b2-a8f19d28087e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:53.839389 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c5c15359-4fc6-4fb5-82b2-a8f19d28087e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:53.845901 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5c15359-4fc6-4fb5-82b2-a8f19d28087e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:53.846353 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5c15359-4fc6-4fb5-82b2-a8f19d28087e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:53.847123 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5c15359-4fc6-4fb5-82b2-a8f19d28087e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:53.847553 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5c15359-4fc6-4fb5-82b2-a8f19d28087e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:53.978230 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c5c15359-4fc6-4fb5-82b2-a8f19d28087e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:53.986226 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c5c15359-4fc6-4fb5-82b2-a8f19d28087e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1677 microversion: 2.1 time: 0.151149 Dec 15 13:42:53.986794 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 440/877] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:53 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:55.004324 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9a642b29-c412-4199-ab8e-7b65627e4c1c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:55.004884 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9a642b29-c412-4199-ab8e-7b65627e4c1c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:55.011303 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a642b29-c412-4199-ab8e-7b65627e4c1c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:55.011748 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a642b29-c412-4199-ab8e-7b65627e4c1c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:55.012543 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a642b29-c412-4199-ab8e-7b65627e4c1c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:55.012974 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9a642b29-c412-4199-ab8e-7b65627e4c1c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:55.145444 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9a642b29-c412-4199-ab8e-7b65627e4c1c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:55.152794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9a642b29-c412-4199-ab8e-7b65627e4c1c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1654 microversion: 2.1 time: 0.152419 Dec 15 13:42:55.153355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 438/878] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:54 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:42:55.169416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1aadc87f-bd53-4218-bd40-ca16a84a3f39 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:42:55.176453 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1aadc87f-bd53-4218-bd40-ca16a84a3f39 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:55.176892 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1aadc87f-bd53-4218-bd40-ca16a84a3f39 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:55.199804 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1aadc87f-bd53-4218-bd40-ca16a84a3f39 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Going to try to start instance {{(pid=122611) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 13:42:55.244757 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1aadc87f-bd53-4218-bd40-ca16a84a3f39 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action" status: 202 len: 0 microversion: 2.1 time: 0.078783 Dec 15 13:42:55.245349 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 441/879] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:42:55 2021] POST /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:42:55.253988 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-85a94c52-3383-40e3-8435-430298874a8b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:55.254673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-85a94c52-3383-40e3-8435-430298874a8b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:55.260689 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85a94c52-3383-40e3-8435-430298874a8b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:55.261118 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85a94c52-3383-40e3-8435-430298874a8b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:55.261952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85a94c52-3383-40e3-8435-430298874a8b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:55.262383 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85a94c52-3383-40e3-8435-430298874a8b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:55.395627 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-85a94c52-3383-40e3-8435-430298874a8b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:55.402887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-85a94c52-3383-40e3-8435-430298874a8b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1663 microversion: 2.1 time: 0.152593 Dec 15 13:42:55.403456 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 439/880] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:55 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:42:56.422882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f755c405-a72c-4d05-88a7-b426a7391c28 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:42:56.423682 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f755c405-a72c-4d05-88a7-b426a7391c28 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:42:56.431509 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f755c405-a72c-4d05-88a7-b426a7391c28 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:56.431965 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f755c405-a72c-4d05-88a7-b426a7391c28 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:56.432832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f755c405-a72c-4d05-88a7-b426a7391c28 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:42:56.433264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f755c405-a72c-4d05-88a7-b426a7391c28 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:42:56.567289 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f755c405-a72c-4d05-88a7-b426a7391c28 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:42:56.574478 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f755c405-a72c-4d05-88a7-b426a7391c28 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1667 microversion: 2.1 time: 0.157454 Dec 15 13:42:56.575038 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 442/881] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:42:56 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:08.009779 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-70f89137-13f3-455c-85e5-9293ee9579ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:08.010762 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-70f89137-13f3-455c-85e5-9293ee9579ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:08.017507 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70f89137-13f3-455c-85e5-9293ee9579ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.017981 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70f89137-13f3-455c-85e5-9293ee9579ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.018750 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70f89137-13f3-455c-85e5-9293ee9579ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.019174 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-70f89137-13f3-455c-85e5-9293ee9579ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.046941 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-70f89137-13f3-455c-85e5-9293ee9579ff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040964 Dec 15 13:43:08.047480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 440/882] 10.222.0.83 () {60 vars in 1342 bytes} [Wed Dec 15 13:43:08 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:08.102314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b1c01393-a9a8-4c15-b974-fe07a6109952 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:08.102813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b1c01393-a9a8-4c15-b974-fe07a6109952 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:08.109012 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b1c01393-a9a8-4c15-b974-fe07a6109952 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.109451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b1c01393-a9a8-4c15-b974-fe07a6109952 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.110250 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b1c01393-a9a8-4c15-b974-fe07a6109952 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.110679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b1c01393-a9a8-4c15-b974-fe07a6109952 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.134711 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b1c01393-a9a8-4c15-b974-fe07a6109952 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:43:08.205698 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b1c01393-a9a8-4c15-b974-fe07a6109952 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 204 len: 0 microversion: 2.20 time: 0.106860 Dec 15 13:43:08.206262 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 443/883] 10.222.0.83 () {60 vars in 1279 bytes} [Wed Dec 15 13:43:08 2021] DELETE /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:43:08.214558 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:08.215206 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:08.221784 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.222235 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.223008 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:08.223443 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:08.356396 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:08.364692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:08.366212 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:08.367377 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-85e72d80-2b67-4f8f-a2fd-cdc9c3d12116 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.156853 Dec 15 13:43:08.367929 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 441/884] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:43:08 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:43:09.387678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:09.388363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:09.394614 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:09.395050 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:09.395812 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:09.396244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:09.524982 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:09.533004 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:09.534525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:09.535673 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3f1aea0b-86fc-4648-a8f1-17ee927cd9ad tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.152145 Dec 15 13:43:09.536243 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 444/885] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:43:09 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:43:10.554730 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:10.555353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:10.564822 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:10.565264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:10.566084 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:10.566512 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:10.717003 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:10.725165 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:10.726845 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '825dcf92d1b64c3d8a6c3e41cec2c836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bddd6292c044cdb9eb8e5bba5ebd4fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:10.728025 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2f51dd92-39a9-45a4-932e-9f9d2653ba50 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 200 len: 1725 microversion: 2.20 time: 0.177060 Dec 15 13:43:10.728572 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 442/886] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:43:10 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 13:43:11.049106 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-b9778f08-2171-4d5d-9ab7-d72e19e7726e req-2c325b9c-0e0f-4ce0-aa37-2b08de2aaa58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8832f44d-71e8-44e3-b955-88a3285a3cb2", "name": "network-vif-deleted", "tag": "eb6d9258-9d98-4855-ac93-8388249d6cd9"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:11.050777 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:11.050777 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:43:11.058269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-b9778f08-2171-4d5d-9ab7-d72e19e7726e req-2c325b9c-0e0f-4ce0-aa37-2b08de2aaa58 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:11.058703 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-b9778f08-2171-4d5d-9ab7-d72e19e7726e req-2c325b9c-0e0f-4ce0-aa37-2b08de2aaa58 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:11.070649 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-b9778f08-2171-4d5d-9ab7-d72e19e7726e req-2c325b9c-0e0f-4ce0-aa37-2b08de2aaa58 service nova] Creating event network-vif-deleted:eb6d9258-9d98-4855-ac93-8388249d6cd9 for instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 on hv-cinder-81322 Dec 15 13:43:11.075769 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-b9778f08-2171-4d5d-9ab7-d72e19e7726e req-2c325b9c-0e0f-4ce0-aa37-2b08de2aaa58 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 Dec 15 13:43:11.076362 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 445/887] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:11.746535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:11.747093 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:11.753528 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:11.754010 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:11.754794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:11.755232 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:11.768760 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] HTTP exception thrown: Instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 could not be found. Dec 15 13:43:11.769338 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Returning 404 to user: Instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:43:11.770193 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ed6f5ded-44f7-4eaf-8eda-c8b1df491bdc tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 404 len: 111 microversion: 2.20 time: 0.027446 Dec 15 13:43:11.770746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 443/888] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:43:11 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:43:11.780005 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-97b0364a-14b2-42d8-8761-e5f3134ff873 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '.version_select at 0x7fd78f6934c0>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:11.798529 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-97b0364a-14b2-42d8-8761-e5f3134ff873 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734225292" status: 204 len: 0 microversion: 2.20 time: 0.022779 Dec 15 13:43:11.799114 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 446/889] 10.222.0.83 () {60 vars in 1261 bytes} [Wed Dec 15 13:43:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734225292 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 13:43:13.601601 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:13.602154 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:13.608466 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:13.609504 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:13.610323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:13.610746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:13.624982 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] HTTP exception thrown: Instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 could not be found. Dec 15 13:43:13.625562 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Returning 404 to user: Instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:43:13.626432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b69cfbbe-294f-44a8-95dc-4cd97cb83c77 tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 404 len: 111 microversion: 2.20 time: 0.028578 Dec 15 13:43:13.626962 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 444/890] 10.222.0.83 () {60 vars in 1279 bytes} [Wed Dec 15 13:43:13 2021] DELETE /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:43:13.635451 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:13.636173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 8832f44d-71e8-44e3-b955-88a3285a3cb2] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:13.642973 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:13.643421 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:13.644210 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:13.644642 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:13.660587 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] HTTP exception thrown: Instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 could not be found. Dec 15 13:43:13.661177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Returning 404 to user: Instance 8832f44d-71e8-44e3-b955-88a3285a3cb2 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:43:13.662031 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1e4dcc17-906e-4bb2-84e3-53e2f243dbff tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2" status: 404 len: 111 microversion: 2.20 time: 0.030766 Dec 15 13:43:13.662583 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 447/891] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:43:13 2021] GET /compute/v2.1/servers/8832f44d-71e8-44e3-b955-88a3285a3cb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:43:14.802773 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:14.803369 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:14.809690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:14.810160 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:14.810924 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:14.811353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:14.825960 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] HTTP exception thrown: Instance 16af4c97-7ce7-47dd-8493-24d19a46221d could not be found. Dec 15 13:43:14.826539 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Returning 404 to user: Instance 16af4c97-7ce7-47dd-8493-24d19a46221d could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:43:14.827355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2c13d68f-1164-4c25-b720-1cbc418d115f tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "DELETE /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 404 len: 111 microversion: 2.20 time: 0.028351 Dec 15 13:43:14.827920 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 445/892] 10.222.0.83 () {60 vars in 1279 bytes} [Wed Dec 15 13:43:14 2021] DELETE /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:43:14.835882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:14.836488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] [instance: 16af4c97-7ce7-47dd-8493-24d19a46221d] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:14.842850 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:14.843305 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:14.844080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:14.844511 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:14.857271 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] HTTP exception thrown: Instance 16af4c97-7ce7-47dd-8493-24d19a46221d could not be found. Dec 15 13:43:14.857883 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] Returning 404 to user: Instance 16af4c97-7ce7-47dd-8493-24d19a46221d could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:43:14.859368 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f7b9a997-17b1-4a65-ab5d-93c878d3aaea tempest-AttachVolumeShelveTestJSON-1167824463 tempest-AttachVolumeShelveTestJSON-1167824463-project] 10.222.0.83 "GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d" status: 404 len: 111 microversion: 2.20 time: 0.026673 Dec 15 13:43:14.859919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 448/893] 10.222.0.83 () {60 vars in 1276 bytes} [Wed Dec 15 13:43:14 2021] GET /compute/v2.1/servers/16af4c97-7ce7-47dd-8493-24d19a46221d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:43:20.211025 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-587234357", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "645914b7-eef4-444f-ad03-9e082234296c"}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:20.265406 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] validate_networks() for [('645914b7-eef4-444f-ad03-9e082234296c', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:43:20.674183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:43:20.674608 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:43:20.675079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:43:20.675480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:43:20.676304 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:43:20.684578 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:20.685020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:20.685864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:20.686299 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:20.702012 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Getting quotas for project 5d663b994c834c358d7a268a08eac730. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:43:20.706637 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Getting quotas for user c5f1e439f9aa45cdbdc0155405423942 and project 5d663b994c834c358d7a268a08eac730. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:43:20.717350 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:43:20.720364 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:43:20.763400 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-abfd78cd-b7c2-4ecd-a36a-1506f7593363 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690041 Dec 15 13:43:20.764087 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 446/894] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:43:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:43:20.774580 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6a4572aa-0892-42fd-9bbd-ddafb2a3dd5e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:20.775176 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6a4572aa-0892-42fd-9bbd-ddafb2a3dd5e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:20.840720 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6a4572aa-0892-42fd-9bbd-ddafb2a3dd5e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:20.848852 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6a4572aa-0892-42fd-9bbd-ddafb2a3dd5e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1217 microversion: 2.1 time: 0.077873 Dec 15 13:43:20.849359 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 449/895] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:20 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:21.872232 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c747f1cb-3b54-4e1e-b06f-251fcdf57ac0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:21.873327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c747f1cb-3b54-4e1e-b06f-251fcdf57ac0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:21.880806 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c747f1cb-3b54-4e1e-b06f-251fcdf57ac0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:21.881379 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c747f1cb-3b54-4e1e-b06f-251fcdf57ac0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:21.882673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c747f1cb-3b54-4e1e-b06f-251fcdf57ac0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:21.883228 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c747f1cb-3b54-4e1e-b06f-251fcdf57ac0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:21.948244 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c747f1cb-3b54-4e1e-b06f-251fcdf57ac0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:21.955775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c747f1cb-3b54-4e1e-b06f-251fcdf57ac0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1275 microversion: 2.1 time: 0.093819 Dec 15 13:43:21.956344 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 447/896] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:21 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:22.973564 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b3718914-ab10-4e88-8aee-9398ff84900e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:22.974308 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b3718914-ab10-4e88-8aee-9398ff84900e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:22.981592 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b3718914-ab10-4e88-8aee-9398ff84900e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:22.982155 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b3718914-ab10-4e88-8aee-9398ff84900e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:22.983008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b3718914-ab10-4e88-8aee-9398ff84900e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:22.983445 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b3718914-ab10-4e88-8aee-9398ff84900e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:23.005067 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-5de0f7e3-c087-46ee-88d4-92e45a573834 req-44b8a57d-d5ed-42cd-8a2d-4d6c623776ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1352a3-d493-4909-8040-b4fbcb58aa09", "tag": "a936e9ef-9421-41df-a2c8-8d0361adf90f"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:23.009614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:23.009614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:43:23.033376 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-5de0f7e3-c087-46ee-88d4-92e45a573834 req-44b8a57d-d5ed-42cd-8a2d-4d6c623776ac service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:23.033883 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-5de0f7e3-c087-46ee-88d4-92e45a573834 req-44b8a57d-d5ed-42cd-8a2d-4d6c623776ac service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:23.056003 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-5de0f7e3-c087-46ee-88d4-92e45a573834 req-44b8a57d-d5ed-42cd-8a2d-4d6c623776ac service nova] Creating event network-changed:a936e9ef-9421-41df-a2c8-8d0361adf90f for instance 4e1352a3-d493-4909-8040-b4fbcb58aa09 on hv-cinder-81322 Dec 15 13:43:23.061505 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-5de0f7e3-c087-46ee-88d4-92e45a573834 req-44b8a57d-d5ed-42cd-8a2d-4d6c623776ac service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062125 Dec 15 13:43:23.062809 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 448/897] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:23.118339 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b3718914-ab10-4e88-8aee-9398ff84900e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:23.126597 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b3718914-ab10-4e88-8aee-9398ff84900e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1317 microversion: 2.1 time: 0.156828 Dec 15 13:43:23.127197 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 450/898] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:22 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:24.146221 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-24793d3c-22dc-4890-857a-346c745636ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:24.147244 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-24793d3c-22dc-4890-857a-346c745636ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:24.153340 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-24793d3c-22dc-4890-857a-346c745636ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:24.153798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-24793d3c-22dc-4890-857a-346c745636ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:24.154578 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-24793d3c-22dc-4890-857a-346c745636ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:24.155002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-24793d3c-22dc-4890-857a-346c745636ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:24.315296 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-24793d3c-22dc-4890-857a-346c745636ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:24.325009 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-24793d3c-22dc-4890-857a-346c745636ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1317 microversion: 2.1 time: 0.184876 Dec 15 13:43:24.325839 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 449/899] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:24 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:25.344176 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-60d63d82-f94e-49c2-900b-8948597008a6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:25.344770 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-60d63d82-f94e-49c2-900b-8948597008a6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:25.351180 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-60d63d82-f94e-49c2-900b-8948597008a6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:25.351622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-60d63d82-f94e-49c2-900b-8948597008a6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:25.352397 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-60d63d82-f94e-49c2-900b-8948597008a6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:25.352828 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-60d63d82-f94e-49c2-900b-8948597008a6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:25.483567 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-60d63d82-f94e-49c2-900b-8948597008a6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:25.490777 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-60d63d82-f94e-49c2-900b-8948597008a6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1317 microversion: 2.1 time: 0.150559 Dec 15 13:43:25.491327 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 451/900] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:25 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:26.508581 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-54b1a425-0e89-442e-8f56-aa6419c18ab1 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:26.509159 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-54b1a425-0e89-442e-8f56-aa6419c18ab1 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:26.516930 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54b1a425-0e89-442e-8f56-aa6419c18ab1 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:26.517427 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54b1a425-0e89-442e-8f56-aa6419c18ab1 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:26.518330 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54b1a425-0e89-442e-8f56-aa6419c18ab1 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:26.518798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54b1a425-0e89-442e-8f56-aa6419c18ab1 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:26.653240 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-54b1a425-0e89-442e-8f56-aa6419c18ab1 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:26.661315 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-54b1a425-0e89-442e-8f56-aa6419c18ab1 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1317 microversion: 2.1 time: 0.156730 Dec 15 13:43:26.661913 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 450/901] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:26 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:27.678720 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4dda1eb3-43a0-4282-a36e-593ef7b5850a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:27.679500 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4dda1eb3-43a0-4282-a36e-593ef7b5850a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:27.686879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4dda1eb3-43a0-4282-a36e-593ef7b5850a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:27.687329 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4dda1eb3-43a0-4282-a36e-593ef7b5850a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:27.688148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4dda1eb3-43a0-4282-a36e-593ef7b5850a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:27.688757 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4dda1eb3-43a0-4282-a36e-593ef7b5850a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:27.820828 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4dda1eb3-43a0-4282-a36e-593ef7b5850a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:27.828166 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4dda1eb3-43a0-4282-a36e-593ef7b5850a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1317 microversion: 2.1 time: 0.152953 Dec 15 13:43:27.828625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 452/902] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:27 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:28.013080 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-4c2aea09-903e-4a83-9aee-3232547606f7 req-292715b2-88bb-4236-9676-8e2b977fb6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1352a3-d493-4909-8040-b4fbcb58aa09", "name": "network-vif-plugged", "status": "completed", "tag": "a936e9ef-9421-41df-a2c8-8d0361adf90f"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:28.014848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:28.014848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:43:28.023789 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-4c2aea09-903e-4a83-9aee-3232547606f7 req-292715b2-88bb-4236-9676-8e2b977fb6c5 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:28.024240 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-4c2aea09-903e-4a83-9aee-3232547606f7 req-292715b2-88bb-4236-9676-8e2b977fb6c5 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:28.038728 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-4c2aea09-903e-4a83-9aee-3232547606f7 req-292715b2-88bb-4236-9676-8e2b977fb6c5 service nova] Creating event network-vif-plugged:a936e9ef-9421-41df-a2c8-8d0361adf90f for instance 4e1352a3-d493-4909-8040-b4fbcb58aa09 on hv-cinder-81322 Dec 15 13:43:28.044364 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-4c2aea09-903e-4a83-9aee-3232547606f7 req-292715b2-88bb-4236-9676-8e2b977fb6c5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035340 Dec 15 13:43:28.044994 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 451/903] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:28.845844 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-875a266c-046a-456c-842f-64d00366ea8c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:28.846487 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-875a266c-046a-456c-842f-64d00366ea8c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:28.853259 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-875a266c-046a-456c-842f-64d00366ea8c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:28.853869 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-875a266c-046a-456c-842f-64d00366ea8c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:28.854637 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-875a266c-046a-456c-842f-64d00366ea8c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:28.855174 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-875a266c-046a-456c-842f-64d00366ea8c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:28.982290 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-875a266c-046a-456c-842f-64d00366ea8c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:28.990197 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-875a266c-046a-456c-842f-64d00366ea8c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1317 microversion: 2.1 time: 0.148746 Dec 15 13:43:28.990758 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 453/904] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:28 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:30.008225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9b805efe-7c9d-48ee-88a1-a7bc7893c7d3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:30.008908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9b805efe-7c9d-48ee-88a1-a7bc7893c7d3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:30.015217 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9b805efe-7c9d-48ee-88a1-a7bc7893c7d3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:30.016245 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9b805efe-7c9d-48ee-88a1-a7bc7893c7d3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:30.017092 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9b805efe-7c9d-48ee-88a1-a7bc7893c7d3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:30.017524 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9b805efe-7c9d-48ee-88a1-a7bc7893c7d3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:30.152912 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9b805efe-7c9d-48ee-88a1-a7bc7893c7d3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:30.160302 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9b805efe-7c9d-48ee-88a1-a7bc7893c7d3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1506 microversion: 2.1 time: 0.156627 Dec 15 13:43:30.160870 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 452/905] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:30 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:31.499734 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-bff017a4-802c-423e-b10a-b9715c8d28b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8c432be-cf76-45a1-a6a9-40d9e5edd33f"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:31.501336 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-bff017a4-802c-423e-b10a-b9715c8d28b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:31.507722 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bff017a4-802c-423e-b10a-b9715c8d28b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:31.508166 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bff017a4-802c-423e-b10a-b9715c8d28b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:31.509208 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bff017a4-802c-423e-b10a-b9715c8d28b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:31.509641 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bff017a4-802c-423e-b10a-b9715c8d28b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:31.762553 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-bff017a4-802c-423e-b10a-b9715c8d28b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266423 Dec 15 13:43:31.763244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 454/906] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:43:31 2021] POST /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:35.699776 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2b05d209-c639-48e3-bae7-38539a8c49fa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:35.701021 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2b05d209-c639-48e3-bae7-38539a8c49fa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:35.707122 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2b05d209-c639-48e3-bae7-38539a8c49fa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:35.707603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2b05d209-c639-48e3-bae7-38539a8c49fa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:35.708459 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2b05d209-c639-48e3-bae7-38539a8c49fa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:35.708809 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2b05d209-c639-48e3-bae7-38539a8c49fa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:35.739032 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2b05d209-c639-48e3-bae7-38539a8c49fa tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042891 Dec 15 13:43:35.739600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 453/907] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:43:35 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:43:35.800895 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-17e80be1-4b93-4462-aedf-ccef3e2e2ebb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:35.801410 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-17e80be1-4b93-4462-aedf-ccef3e2e2ebb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:35.807745 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-17e80be1-4b93-4462-aedf-ccef3e2e2ebb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:35.808260 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-17e80be1-4b93-4462-aedf-ccef3e2e2ebb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:35.809095 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-17e80be1-4b93-4462-aedf-ccef3e2e2ebb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:35.809538 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-17e80be1-4b93-4462-aedf-ccef3e2e2ebb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:35.837880 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-17e80be1-4b93-4462-aedf-ccef3e2e2ebb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:43:36.085282 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-17e80be1-4b93-4462-aedf-ccef3e2e2ebb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 204 len: 0 microversion: 2.1 time: 0.289448 Dec 15 13:43:36.085784 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 455/908] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:43:35 2021] DELETE /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:43:36.094680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-52986704-fbcb-482b-bb88-47eeed382f79 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:36.095275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-52986704-fbcb-482b-bb88-47eeed382f79 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:36.103433 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-52986704-fbcb-482b-bb88-47eeed382f79 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:36.103935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-52986704-fbcb-482b-bb88-47eeed382f79 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:36.104680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-52986704-fbcb-482b-bb88-47eeed382f79 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:36.105108 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-52986704-fbcb-482b-bb88-47eeed382f79 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:36.247283 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-52986704-fbcb-482b-bb88-47eeed382f79 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:36.256463 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-52986704-fbcb-482b-bb88-47eeed382f79 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1673 microversion: 2.1 time: 0.166008 Dec 15 13:43:36.256977 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 454/909] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:36 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:37.277037 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f960b24c-f75a-46bb-9857-8c96fec4cba7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:37.277919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f960b24c-f75a-46bb-9857-8c96fec4cba7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:37.285851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f960b24c-f75a-46bb-9857-8c96fec4cba7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:37.286332 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f960b24c-f75a-46bb-9857-8c96fec4cba7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:37.287437 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f960b24c-f75a-46bb-9857-8c96fec4cba7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:37.287951 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f960b24c-f75a-46bb-9857-8c96fec4cba7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:37.434506 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f960b24c-f75a-46bb-9857-8c96fec4cba7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:37.443222 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f960b24c-f75a-46bb-9857-8c96fec4cba7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1673 microversion: 2.1 time: 0.171847 Dec 15 13:43:37.443813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 456/910] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:37 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:38.462738 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a1cb3c98-7874-4a8a-969b-d55b5019139b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:38.463390 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a1cb3c98-7874-4a8a-969b-d55b5019139b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:38.470019 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a1cb3c98-7874-4a8a-969b-d55b5019139b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:38.470521 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a1cb3c98-7874-4a8a-969b-d55b5019139b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:38.471282 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a1cb3c98-7874-4a8a-969b-d55b5019139b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:38.471711 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a1cb3c98-7874-4a8a-969b-d55b5019139b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:38.603592 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a1cb3c98-7874-4a8a-969b-d55b5019139b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:38.611609 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a1cb3c98-7874-4a8a-969b-d55b5019139b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1673 microversion: 2.1 time: 0.152660 Dec 15 13:43:38.612177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 455/911] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:38 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:39.630326 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-83603c6f-7a3e-43c2-b085-4ec1ceda4ca6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:39.630926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-83603c6f-7a3e-43c2-b085-4ec1ceda4ca6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:39.637218 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-83603c6f-7a3e-43c2-b085-4ec1ceda4ca6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:39.637661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-83603c6f-7a3e-43c2-b085-4ec1ceda4ca6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:39.638469 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-83603c6f-7a3e-43c2-b085-4ec1ceda4ca6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:39.638896 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-83603c6f-7a3e-43c2-b085-4ec1ceda4ca6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:39.772481 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-83603c6f-7a3e-43c2-b085-4ec1ceda4ca6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:39.779753 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-83603c6f-7a3e-43c2-b085-4ec1ceda4ca6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1673 microversion: 2.1 time: 0.153070 Dec 15 13:43:39.780318 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 457/912] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:39 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:40.339741 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1800412973", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "645914b7-eef4-444f-ad03-9e082234296c"}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:40.395115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] validate_networks() for [('645914b7-eef4-444f-ad03-9e082234296c', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:43:40.764663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:43:40.765113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:43:40.765624 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:43:40.766583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:43:40.767019 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:43:40.775902 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:40.776370 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:40.777231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:40.777687 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:40.796064 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Getting quotas for project 5d663b994c834c358d7a268a08eac730. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:43:40.796765 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9a4d837f-5a6a-4393-b268-599d08135190 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:40.798001 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9a4d837f-5a6a-4393-b268-599d08135190 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:40.800189 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Getting quotas for user c5f1e439f9aa45cdbdc0155405423942 and project 5d663b994c834c358d7a268a08eac730. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:43:40.804303 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9a4d837f-5a6a-4393-b268-599d08135190 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:40.804820 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9a4d837f-5a6a-4393-b268-599d08135190 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:40.805701 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9a4d837f-5a6a-4393-b268-599d08135190 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:40.806349 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9a4d837f-5a6a-4393-b268-599d08135190 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:40.811762 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:43:40.814316 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:43:40.862211 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-dfe42133-cb7e-441d-adf6-e9d72e8445cf tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525828 Dec 15 13:43:40.868771 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 456/913] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:43:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:43:40.874663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8b7bebbe-f398-4d31-be16-cdc2f6755d5c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:40.875338 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8b7bebbe-f398-4d31-be16-cdc2f6755d5c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:40.943112 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8b7bebbe-f398-4d31-be16-cdc2f6755d5c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:40.952139 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8b7bebbe-f398-4d31-be16-cdc2f6755d5c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1218 microversion: 2.1 time: 0.081983 Dec 15 13:43:40.952945 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 457/914] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:40 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:40.983830 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9a4d837f-5a6a-4393-b268-599d08135190 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:40.991574 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9a4d837f-5a6a-4393-b268-599d08135190 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1673 microversion: 2.1 time: 0.198997 Dec 15 13:43:40.992173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 458/915] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:40 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:41.660950 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-1c89de9f-b9c5-4b27-bdd4-c60af9edc17b req-8e91de20-0c7a-4fb7-8713-598dcb4b2015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09248873-3a26-46a0-bbd1-b3574f74bc7a", "name": "network-vif-deleted", "tag": "7ec98862-6702-437c-a8ca-fe7bcaf393ab"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:41.663409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:41.663409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:43:41.674196 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-1c89de9f-b9c5-4b27-bdd4-c60af9edc17b req-8e91de20-0c7a-4fb7-8713-598dcb4b2015 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:41.675374 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-1c89de9f-b9c5-4b27-bdd4-c60af9edc17b req-8e91de20-0c7a-4fb7-8713-598dcb4b2015 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:41.687057 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-1c89de9f-b9c5-4b27-bdd4-c60af9edc17b req-8e91de20-0c7a-4fb7-8713-598dcb4b2015 service nova] Creating event network-vif-deleted:7ec98862-6702-437c-a8ca-fe7bcaf393ab for instance 09248873-3a26-46a0-bbd1-b3574f74bc7a on hv-cinder-81322 Dec 15 13:43:41.694520 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-1c89de9f-b9c5-4b27-bdd4-c60af9edc17b req-8e91de20-0c7a-4fb7-8713-598dcb4b2015 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037151 Dec 15 13:43:41.695355 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 458/916] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:41.970519 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0f692ddb-3ef3-4129-8125-410720496344 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:41.971128 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0f692ddb-3ef3-4129-8125-410720496344 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:41.978207 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0f692ddb-3ef3-4129-8125-410720496344 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:41.979188 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0f692ddb-3ef3-4129-8125-410720496344 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:41.980193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0f692ddb-3ef3-4129-8125-410720496344 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:41.980788 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0f692ddb-3ef3-4129-8125-410720496344 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:42.008716 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:42.009429 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:42.018581 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:42.019564 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:42.020859 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:42.021381 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:42.046206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0f692ddb-3ef3-4129-8125-410720496344 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:42.058887 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0f692ddb-3ef3-4129-8125-410720496344 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1288 microversion: 2.1 time: 0.092351 Dec 15 13:43:42.060602 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:42.061279 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:42.061843 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lazy-loading 'fault' on Instance uuid 09248873-3a26-46a0-bbd1-b3574f74bc7a {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:43:42.070666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 459/917] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:41 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:42.106286 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:42.115071 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9c87bb14-d150-45b6-b1e2-e9f642a32d1b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 200 len: 1328 microversion: 2.1 time: 0.110359 Dec 15 13:43:42.115918 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 459/918] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:42 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:42.554506 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1496135397", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2022049678", "security_groups": [{"name": "tempest-secgroup-smoke-1219894246"}], "block_device_mapping_v2": [{"uuid": "ee2e0807-128e-4fa3-8aa0-7597f411f41b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7bf9178e-ef91-4e23-a896-35ca60172592"}]}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:42.703494 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.network.neutron [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] validate_networks() for [('7bf9178e-ef91-4e23-a896-35ca60172592', None, None, None, None, None)] {{(pid=122611) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:43:43.076775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a48ec37a-6eb2-4d7a-b113-3464873f3ad5 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:43.077848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a48ec37a-6eb2-4d7a-b113-3464873f3ad5 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:43.079807 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Flavor limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:43:43.080811 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Image limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:43:43.081352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Flavor pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:43:43.082037 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Image pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:43:43.082604 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:43:43.085183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a48ec37a-6eb2-4d7a-b113-3464873f3ad5 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.085856 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a48ec37a-6eb2-4d7a-b113-3464873f3ad5 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.086798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a48ec37a-6eb2-4d7a-b113-3464873f3ad5 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.087383 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a48ec37a-6eb2-4d7a-b113-3464873f3ad5 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.091817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.092399 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.093698 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.094961 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.111586 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for project c0da9050a08e442887ca8dc346374836. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:43:43.115998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Getting quotas for user 7e3a3afdfc4c44a29d0f3df50a5ed2ac and project c0da9050a08e442887ca8dc346374836. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:43:43.176883 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Going to run 1 instances... {{(pid=122611) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:43:43.179085 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee2e0807-128e-4fa3-8aa0-7597f411f41b',volume_size=None,volume_type=None)] {{(pid=122611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:43:43.233555 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a48ec37a-6eb2-4d7a-b113-3464873f3ad5 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:43.242897 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a48ec37a-6eb2-4d7a-b113-3464873f3ad5 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1318 microversion: 2.1 time: 0.170143 Dec 15 13:43:43.243433 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 460/919] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:43 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:43.257294 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:43.258117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:43.264399 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.265115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.266662 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.267226 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.283573 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] HTTP exception thrown: Instance 09248873-3a26-46a0-bbd1-b3574f74bc7a could not be found. Dec 15 13:43:43.284249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Returning 404 to user: Instance 09248873-3a26-46a0-bbd1-b3574f74bc7a could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:43:43.285362 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d41ee1d8-b75e-4793-b70b-5ee92d6ef5a5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 404 len: 111 microversion: 2.1 time: 0.040613 Dec 15 13:43:43.290010 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 461/920] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:43 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:43:43.294811 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-06980b48-f10f-45d3-a24c-1453252b4b71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '.version_select at 0x7fd78ff97040>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:43.299056 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-06980b48-f10f-45d3-a24c-1453252b4b71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [7bcc102d-4654-4a46-aee3-71abf632e446] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 15 13:43:43.319082 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f293ed54-1f98-4805-91b7-095da40c53a0 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769512 Dec 15 13:43:43.319920 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 460/921] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:43:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:43:43.329974 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1a87727e-be68-45fe-8fa8-337fa7412109 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:43.330583 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1a87727e-be68-45fe-8fa8-337fa7412109 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:43.399173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1a87727e-be68-45fe-8fa8-337fa7412109 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:43.407059 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1a87727e-be68-45fe-8fa8-337fa7412109 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1095 microversion: 2.1 time: 0.080694 Dec 15 13:43:43.407626 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 461/922] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:43 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:43.715917 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-b9967fe5-dccd-47a0-90e0-8a9cf7c4c0b8 req-09ab856e-017b-467e-ba18-8352ae709650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69324657-790e-43bb-b7e1-329f460b482e", "tag": "52bdc64f-eed7-4cad-83de-af3e9be9b44a"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:43.717480 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:43.717480 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:43:43.726164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-b9967fe5-dccd-47a0-90e0-8a9cf7c4c0b8 req-09ab856e-017b-467e-ba18-8352ae709650 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:43.726950 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-b9967fe5-dccd-47a0-90e0-8a9cf7c4c0b8 req-09ab856e-017b-467e-ba18-8352ae709650 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:43.742561 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-b9967fe5-dccd-47a0-90e0-8a9cf7c4c0b8 req-09ab856e-017b-467e-ba18-8352ae709650 service nova] Creating event network-changed:52bdc64f-eed7-4cad-83de-af3e9be9b44a for instance 69324657-790e-43bb-b7e1-329f460b482e on hv-cinder-81322 Dec 15 13:43:43.748423 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-b9967fe5-dccd-47a0-90e0-8a9cf7c4c0b8 req-09ab856e-017b-467e-ba18-8352ae709650 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036634 Dec 15 13:43:43.749111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 462/923] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:43:44.261993 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b6f91177-db54-4fc5-a3ff-e783ea6bc241 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:44.262680 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b6f91177-db54-4fc5-a3ff-e783ea6bc241 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:44.271011 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b6f91177-db54-4fc5-a3ff-e783ea6bc241 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:44.271537 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b6f91177-db54-4fc5-a3ff-e783ea6bc241 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:44.272323 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b6f91177-db54-4fc5-a3ff-e783ea6bc241 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:44.273386 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b6f91177-db54-4fc5-a3ff-e783ea6bc241 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:44.321283 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO oslo.messaging._drivers.impl_rabbit [None req-06980b48-f10f-45d3-a24c-1453252b4b71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [7bcc102d-4654-4a46-aee3-71abf632e446] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 35058. Dec 15 13:43:44.340590 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-06980b48-f10f-45d3-a24c-1453252b4b71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041386510" status: 202 len: 0 microversion: 2.1 time: 1.049192 Dec 15 13:43:44.341183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 462/924] 10.222.0.83 () {58 vars in 1220 bytes} [Wed Dec 15 13:43:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041386510 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:43:44.425434 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-57649016-357f-4a00-90a4-a7f3a11febeb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:44.426554 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-57649016-357f-4a00-90a4-a7f3a11febeb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:44.437527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-57649016-357f-4a00-90a4-a7f3a11febeb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:44.438844 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-57649016-357f-4a00-90a4-a7f3a11febeb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:44.439908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-57649016-357f-4a00-90a4-a7f3a11febeb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:44.441312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-57649016-357f-4a00-90a4-a7f3a11febeb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:44.542905 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-57649016-357f-4a00-90a4-a7f3a11febeb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:44.555375 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b6f91177-db54-4fc5-a3ff-e783ea6bc241 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:44.565175 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b6f91177-db54-4fc5-a3ff-e783ea6bc241 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1318 microversion: 2.1 time: 0.307233 Dec 15 13:43:44.567381 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 463/925] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:44 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:44.569928 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-57649016-357f-4a00-90a4-a7f3a11febeb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1211 microversion: 2.1 time: 0.149461 Dec 15 13:43:44.570499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 463/926] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:44 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1211 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:45.585132 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7e59f974-c285-4070-bf20-28dea89e45a9 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:45.585905 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7e59f974-c285-4070-bf20-28dea89e45a9 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:45.587431 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f3dd13be-8b54-4dec-b6d9-5c0699d0e847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:45.588166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f3dd13be-8b54-4dec-b6d9-5c0699d0e847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:45.593660 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e59f974-c285-4070-bf20-28dea89e45a9 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:45.594732 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e59f974-c285-4070-bf20-28dea89e45a9 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:45.595709 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e59f974-c285-4070-bf20-28dea89e45a9 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:45.595910 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3dd13be-8b54-4dec-b6d9-5c0699d0e847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:45.596468 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7e59f974-c285-4070-bf20-28dea89e45a9 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:45.596652 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3dd13be-8b54-4dec-b6d9-5c0699d0e847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:45.597334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3dd13be-8b54-4dec-b6d9-5c0699d0e847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:45.597868 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f3dd13be-8b54-4dec-b6d9-5c0699d0e847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:45.693075 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f3dd13be-8b54-4dec-b6d9-5c0699d0e847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:45.702658 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f3dd13be-8b54-4dec-b6d9-5c0699d0e847 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1199 microversion: 2.1 time: 0.118987 Dec 15 13:43:45.704611 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 464/927] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:45 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:45.715202 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-efe6bd89-1e77-4ddc-9c27-e2976711a00e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'create', calling method: .version_select at 0x7fd79c91dca0>, body: {"keypair": {"name": "tempest-keypair-1182403448"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:45.742369 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-efe6bd89-1e77-4ddc-9c27-e2976711a00e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'key_pairs'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:43:45.745991 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-efe6bd89-1e77-4ddc-9c27-e2976711a00e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for user 4c98a5d1c09e43c99bcbc1e9785d1edd and project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'key_pairs'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:43:45.876052 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-7e59f974-c285-4070-bf20-28dea89e45a9 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:45.885177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7e59f974-c285-4070-bf20-28dea89e45a9 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1318 microversion: 2.1 time: 0.303320 Dec 15 13:43:45.896671 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 464/928] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:45 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:46.044747 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-efe6bd89-1e77-4ddc-9c27-e2976711a00e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'key_pairs'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:43:46.049986 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-efe6bd89-1e77-4ddc-9c27-e2976711a00e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for user 4c98a5d1c09e43c99bcbc1e9785d1edd and project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'key_pairs'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:43:46.064805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-efe6bd89-1e77-4ddc-9c27-e2976711a00e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.358645 Dec 15 13:43:46.065708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 465/929] 10.222.0.83 () {60 vars in 1157 bytes} [Wed Dec 15 13:43:45 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:46.729997 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-263d3dbf-4408-4dd1-9d61-59d955ca8237 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:46.731254 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-263d3dbf-4408-4dd1-9d61-59d955ca8237 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:46.738291 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-263d3dbf-4408-4dd1-9d61-59d955ca8237 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:46.738658 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-263d3dbf-4408-4dd1-9d61-59d955ca8237 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:46.739447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-263d3dbf-4408-4dd1-9d61-59d955ca8237 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:46.739882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-263d3dbf-4408-4dd1-9d61-59d955ca8237 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:46.786887 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-f1a4035c-a800-4da6-bb2f-fd3c1e5d2013 req-d7c1cacd-1903-4559-b729-c8bfa3b35a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9aceb1-a94c-418d-bbb3-bcc4b14f482e", "tag": "ad5d037e-580b-4432-81b5-1d7c3583d89d"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:46.788618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:46.788618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:43:46.813107 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-f1a4035c-a800-4da6-bb2f-fd3c1e5d2013 req-d7c1cacd-1903-4559-b729-c8bfa3b35a40 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:46.814441 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-f1a4035c-a800-4da6-bb2f-fd3c1e5d2013 req-d7c1cacd-1903-4559-b729-c8bfa3b35a40 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:46.832190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-f1a4035c-a800-4da6-bb2f-fd3c1e5d2013 req-d7c1cacd-1903-4559-b729-c8bfa3b35a40 service nova] Creating event network-changed:ad5d037e-580b-4432-81b5-1d7c3583d89d for instance 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e on hv-cinder-81322 Dec 15 13:43:46.850619 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-f1a4035c-a800-4da6-bb2f-fd3c1e5d2013 req-d7c1cacd-1903-4559-b729-c8bfa3b35a40 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072768 Dec 15 13:43:46.851771 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 466/930] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:46.904359 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c04d4d0d-245b-4655-a149-7aaaba123e2d tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:46.905069 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c04d4d0d-245b-4655-a149-7aaaba123e2d tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:46.911826 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c04d4d0d-245b-4655-a149-7aaaba123e2d tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:46.912274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c04d4d0d-245b-4655-a149-7aaaba123e2d tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:46.913067 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c04d4d0d-245b-4655-a149-7aaaba123e2d tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:46.913500 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c04d4d0d-245b-4655-a149-7aaaba123e2d tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:47.036491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-263d3dbf-4408-4dd1-9d61-59d955ca8237 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:47.047211 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-263d3dbf-4408-4dd1-9d61-59d955ca8237 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.320723 Dec 15 13:43:47.047702 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 465/931] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:46 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:47.153102 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c04d4d0d-245b-4655-a149-7aaaba123e2d tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:47.160708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c04d4d0d-245b-4655-a149-7aaaba123e2d tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1318 microversion: 2.1 time: 0.260401 Dec 15 13:43:47.161273 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 467/932] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:46 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:47.756042 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1386320130", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83a3c4cb-56da-41d3-bc6c-42f445cbeed5"}], "security_groups": [{"name": "tempest-securitygroup--1726011098"}], "key_name": "tempest-keypair-1182403448", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:47.899039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.network.neutron [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] validate_networks() for [('83a3c4cb-56da-41d3-bc6c-42f445cbeed5', None, None, None, None, None)] {{(pid=122611) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:43:48.046885 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-989b632c-8274-474b-9e6c-5b7d7ea3263c req-95a6a7e5-a9e4-43b7-baf2-5ca925476315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69324657-790e-43bb-b7e1-329f460b482e", "name": "network-vif-plugged", "status": "completed", "tag": "52bdc64f-eed7-4cad-83de-af3e9be9b44a"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:48.049614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:48.049614 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:43:48.057296 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-989b632c-8274-474b-9e6c-5b7d7ea3263c req-95a6a7e5-a9e4-43b7-baf2-5ca925476315 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:48.057973 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-989b632c-8274-474b-9e6c-5b7d7ea3263c req-95a6a7e5-a9e4-43b7-baf2-5ca925476315 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:48.069933 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-989b632c-8274-474b-9e6c-5b7d7ea3263c req-95a6a7e5-a9e4-43b7-baf2-5ca925476315 service nova] Creating event network-vif-plugged:52bdc64f-eed7-4cad-83de-af3e9be9b44a for instance 69324657-790e-43bb-b7e1-329f460b482e on hv-cinder-81322 Dec 15 13:43:48.074794 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-989b632c-8274-474b-9e6c-5b7d7ea3263c req-95a6a7e5-a9e4-43b7-baf2-5ca925476315 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031557 Dec 15 13:43:48.075641 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 468/933] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:43:48.080559 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-fcc7899a-596b-4904-9d8f-c60d904a32ad tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:48.081420 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-fcc7899a-596b-4904-9d8f-c60d904a32ad tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:48.087721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fcc7899a-596b-4904-9d8f-c60d904a32ad tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:48.088407 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fcc7899a-596b-4904-9d8f-c60d904a32ad tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:48.089374 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fcc7899a-596b-4904-9d8f-c60d904a32ad tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:48.090161 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fcc7899a-596b-4904-9d8f-c60d904a32ad tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:48.399521 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-fcc7899a-596b-4904-9d8f-c60d904a32ad tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:48.408123 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-fcc7899a-596b-4904-9d8f-c60d904a32ad tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.331180 Dec 15 13:43:48.408727 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 469/934] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:48 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:48.413264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-246e7a59-c950-496c-bf01-2f8890851764 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:48.414228 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-246e7a59-c950-496c-bf01-2f8890851764 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:48.420417 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-246e7a59-c950-496c-bf01-2f8890851764 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:48.420864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-246e7a59-c950-496c-bf01-2f8890851764 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:48.421669 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-246e7a59-c950-496c-bf01-2f8890851764 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:48.422137 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-246e7a59-c950-496c-bf01-2f8890851764 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:48.426953 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Flavor limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:43:48.427503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Image limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:43:48.428250 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Flavor pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:43:48.428765 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Image pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:43:48.429281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:43:48.439102 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:48.439694 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:48.440607 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:48.441113 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:48.458182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:43:48.462229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Getting quotas for user 4c98a5d1c09e43c99bcbc1e9785d1edd and project 10799d1b1db34e69a6c6bba276744b0f. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:43:48.474278 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Going to run 1 instances... {{(pid=122611) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:43:48.476726 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:43:48.525582 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c4fffae4-ddb7-4335-9627-0b2ad5e79727 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.773541 Dec 15 13:43:48.526757 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 466/935] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:43:47 2021] POST /compute/v2.1/servers => generated 402 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:43:48.537254 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e188f08f-8432-49dc-b8c8-466ce9cdce72 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:48.537890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e188f08f-8432-49dc-b8c8-466ce9cdce72 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:48.564899 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-246e7a59-c950-496c-bf01-2f8890851764 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:48.574373 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-246e7a59-c950-496c-bf01-2f8890851764 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1318 microversion: 2.1 time: 0.164423 Dec 15 13:43:48.584786 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 470/936] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:48 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:48.596080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e188f08f-8432-49dc-b8c8-466ce9cdce72 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:48.604153 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e188f08f-8432-49dc-b8c8-466ce9cdce72 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1238 microversion: 2.1 time: 0.070487 Dec 15 13:43:48.604715 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 467/937] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:48 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:49.424159 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-901c75ea-c927-40f6-aee1-75934e2edda2 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:49.424822 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-901c75ea-c927-40f6-aee1-75934e2edda2 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:49.431531 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-901c75ea-c927-40f6-aee1-75934e2edda2 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:49.431986 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-901c75ea-c927-40f6-aee1-75934e2edda2 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:49.432770 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-901c75ea-c927-40f6-aee1-75934e2edda2 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:49.433225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-901c75ea-c927-40f6-aee1-75934e2edda2 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:49.593832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8dd304de-7f41-4baf-985f-4063d55c7d12 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:49.595219 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8dd304de-7f41-4baf-985f-4063d55c7d12 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:49.604262 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8dd304de-7f41-4baf-985f-4063d55c7d12 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:49.605120 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8dd304de-7f41-4baf-985f-4063d55c7d12 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:49.606103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8dd304de-7f41-4baf-985f-4063d55c7d12 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:49.606685 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8dd304de-7f41-4baf-985f-4063d55c7d12 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:49.664128 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-901c75ea-c927-40f6-aee1-75934e2edda2 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:49.682103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-901c75ea-c927-40f6-aee1-75934e2edda2 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.259884 Dec 15 13:43:49.682621 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 471/938] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:49 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:49.690037 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-069f502b-5c93-420d-a386-6a60a4c02e93 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:49.690911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-069f502b-5c93-420d-a386-6a60a4c02e93 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:49.698803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-069f502b-5c93-420d-a386-6a60a4c02e93 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:49.699249 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-069f502b-5c93-420d-a386-6a60a4c02e93 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:49.700565 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-069f502b-5c93-420d-a386-6a60a4c02e93 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:49.701259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-069f502b-5c93-420d-a386-6a60a4c02e93 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:49.782348 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-069f502b-5c93-420d-a386-6a60a4c02e93 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:49.789989 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-069f502b-5c93-420d-a386-6a60a4c02e93 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1296 microversion: 2.1 time: 0.105877 Dec 15 13:43:49.790432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 472/939] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:49 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:49.899491 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-8dd304de-7f41-4baf-985f-4063d55c7d12 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:49.906837 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8dd304de-7f41-4baf-985f-4063d55c7d12 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1318 microversion: 2.1 time: 0.319634 Dec 15 13:43:49.907420 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 468/940] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:49 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:50.698513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-97ab966b-a8d1-466c-8e5a-cf5b7f33012c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:50.699116 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-97ab966b-a8d1-466c-8e5a-cf5b7f33012c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:50.706528 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-97ab966b-a8d1-466c-8e5a-cf5b7f33012c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:50.706995 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-97ab966b-a8d1-466c-8e5a-cf5b7f33012c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:50.708081 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-97ab966b-a8d1-466c-8e5a-cf5b7f33012c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:50.708800 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-97ab966b-a8d1-466c-8e5a-cf5b7f33012c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:50.807215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6053bbd5-1847-4622-86fa-1abef86f5605 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:50.807792 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6053bbd5-1847-4622-86fa-1abef86f5605 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:50.814223 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6053bbd5-1847-4622-86fa-1abef86f5605 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:50.814725 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6053bbd5-1847-4622-86fa-1abef86f5605 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:50.815542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6053bbd5-1847-4622-86fa-1abef86f5605 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:50.815975 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6053bbd5-1847-4622-86fa-1abef86f5605 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.026318 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-97ab966b-a8d1-466c-8e5a-cf5b7f33012c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:51.033750 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-97ab966b-a8d1-466c-8e5a-cf5b7f33012c tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.338887 Dec 15 13:43:51.034352 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 473/941] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:50 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:51.046363 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-294e1264-70d5-4a8f-a549-99a6d8570046 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:51.046968 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-294e1264-70d5-4a8f-a549-99a6d8570046 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:51.052829 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-294e1264-70d5-4a8f-a549-99a6d8570046 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.053271 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-294e1264-70d5-4a8f-a549-99a6d8570046 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.054070 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-294e1264-70d5-4a8f-a549-99a6d8570046 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.054506 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-294e1264-70d5-4a8f-a549-99a6d8570046 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.106887 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6053bbd5-1847-4622-86fa-1abef86f5605 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:51.114146 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6053bbd5-1847-4622-86fa-1abef86f5605 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1364 microversion: 2.1 time: 0.310615 Dec 15 13:43:51.114707 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 469/942] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:50 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:51.301404 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-294e1264-70d5-4a8f-a549-99a6d8570046 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:51.309486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-294e1264-70d5-4a8f-a549-99a6d8570046 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1508 microversion: 2.1 time: 0.274104 Dec 15 13:43:51.310180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 474/943] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:51 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:51.331436 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8c432be-cf76-45a1-a6a9-40d9e5edd33f"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:51.333216 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:51.340643 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.341357 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.342381 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.342813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.429096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] HTTP exception thrown: Invalid volume: volume a8c432be-cf76-45a1-a6a9-40d9e5edd33f is already attached to instances: 4e1352a3-d493-4909-8040-b4fbcb58aa09 Dec 15 13:43:51.429698 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Returning 400 to user: Invalid volume: volume a8c432be-cf76-45a1-a6a9-40d9e5edd33f is already attached to instances: 4e1352a3-d493-4909-8040-b4fbcb58aa09 {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:43:51.430557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0d55fcc5-a688-4963-a478-a34f0b24b6c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106893 Dec 15 13:43:51.431097 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 470/944] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:43:51 2021] POST /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 13:43:51.466903 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-ebce9be9-190b-489e-a0fc-15b95bdbf736 req-868c62b8-3ff4-4999-901d-a2f79647ea39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd0d7fb7-7dbd-4a9f-9366-a551a0899d91", "tag": "7cd7dbfc-bd2e-4f55-898d-aa1bc487bb07"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:51.468831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:51.468831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:43:51.486831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-ebce9be9-190b-489e-a0fc-15b95bdbf736 req-868c62b8-3ff4-4999-901d-a2f79647ea39 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.487433 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-ebce9be9-190b-489e-a0fc-15b95bdbf736 req-868c62b8-3ff4-4999-901d-a2f79647ea39 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.505615 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-ebce9be9-190b-489e-a0fc-15b95bdbf736 req-868c62b8-3ff4-4999-901d-a2f79647ea39 service nova] Creating event network-changed:7cd7dbfc-bd2e-4f55-898d-aa1bc487bb07 for instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 on hv-cinder-81322 Dec 15 13:43:51.510889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-ebce9be9-190b-489e-a0fc-15b95bdbf736 req-868c62b8-3ff4-4999-901d-a2f79647ea39 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047527 Dec 15 13:43:51.511744 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 475/945] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:51.530293 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-eea827c9-3b8a-421e-88a3-7f408443771c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:51.530913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-eea827c9-3b8a-421e-88a3-7f408443771c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:51.537341 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eea827c9-3b8a-421e-88a3-7f408443771c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.537954 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eea827c9-3b8a-421e-88a3-7f408443771c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.538811 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eea827c9-3b8a-421e-88a3-7f408443771c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.539306 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eea827c9-3b8a-421e-88a3-7f408443771c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.630083 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-eea827c9-3b8a-421e-88a3-7f408443771c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lazy-loading 'services' on Instance uuid 4e1352a3-d493-4909-8040-b4fbcb58aa09 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:43:51.705333 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-eea827c9-3b8a-421e-88a3-7f408443771c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09/os-volume_attachments/a8c432be-cf76-45a1-a6a9-40d9e5edd33f" status: 202 len: 0 microversion: 2.1 time: 0.178687 Dec 15 13:43:51.706018 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 471/946] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:43:51 2021] DELETE /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09/os-volume_attachments/a8c432be-cf76-45a1-a6a9-40d9e5edd33f => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:43:51.715218 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-02cda87f-0a49-433e-8838-6288a3fd4f7c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:51.716895 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-02cda87f-0a49-433e-8838-6288a3fd4f7c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:51.724429 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02cda87f-0a49-433e-8838-6288a3fd4f7c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.725030 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02cda87f-0a49-433e-8838-6288a3fd4f7c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.726021 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02cda87f-0a49-433e-8838-6288a3fd4f7c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:51.726507 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-02cda87f-0a49-433e-8838-6288a3fd4f7c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:51.757729 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-02cda87f-0a49-433e-8838-6288a3fd4f7c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Dec 15 13:43:51.758289 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 476/947] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:43:51 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:43:52.050845 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4bf376fb-3e6a-46af-b7f7-af07b677cc10 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:52.051535 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4bf376fb-3e6a-46af-b7f7-af07b677cc10 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:52.058050 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4bf376fb-3e6a-46af-b7f7-af07b677cc10 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:52.058502 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4bf376fb-3e6a-46af-b7f7-af07b677cc10 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:52.059273 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4bf376fb-3e6a-46af-b7f7-af07b677cc10 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:52.059728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4bf376fb-3e6a-46af-b7f7-af07b677cc10 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:52.131142 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-841e6fb9-66ad-4722-bdeb-fcc793574d20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:52.131745 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-841e6fb9-66ad-4722-bdeb-fcc793574d20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:52.137798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-841e6fb9-66ad-4722-bdeb-fcc793574d20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:52.138253 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-841e6fb9-66ad-4722-bdeb-fcc793574d20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:52.139026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-841e6fb9-66ad-4722-bdeb-fcc793574d20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:52.139463 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-841e6fb9-66ad-4722-bdeb-fcc793574d20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:52.401273 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4bf376fb-3e6a-46af-b7f7-af07b677cc10 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:52.409654 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4bf376fb-3e6a-46af-b7f7-af07b677cc10 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.362797 Dec 15 13:43:52.410404 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 472/948] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:52 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:52.532810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-841e6fb9-66ad-4722-bdeb-fcc793574d20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:52.540148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-841e6fb9-66ad-4722-bdeb-fcc793574d20 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1364 microversion: 2.1 time: 0.412486 Dec 15 13:43:52.540737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 477/949] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:52 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1364 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:52.769362 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-516a4100-668a-4348-ac87-351df904f0c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:52.770382 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-516a4100-668a-4348-ac87-351df904f0c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:52.776176 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-516a4100-668a-4348-ac87-351df904f0c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:52.776628 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-516a4100-668a-4348-ac87-351df904f0c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:52.777428 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-516a4100-668a-4348-ac87-351df904f0c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:52.777919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-516a4100-668a-4348-ac87-351df904f0c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:52.805949 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-516a4100-668a-4348-ac87-351df904f0c6 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041005 Dec 15 13:43:52.806510 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 473/950] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:43:52 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:43:52.902486 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-533041422", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "645914b7-eef4-444f-ad03-9e082234296c"}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:52.960563 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] validate_networks() for [('645914b7-eef4-444f-ad03-9e082234296c', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:43:53.309902 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:43:53.310318 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:43:53.310782 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:43:53.311181 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:43:53.311622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:43:53.320095 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:53.320569 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:53.321388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:53.321869 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:53.337546 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Getting quotas for project 5d663b994c834c358d7a268a08eac730. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:43:53.341367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Getting quotas for user c5f1e439f9aa45cdbdc0155405423942 and project 5d663b994c834c358d7a268a08eac730. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:43:53.352503 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:43:53.354798 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:43:53.405390 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0f038861-b099-46a0-9ef6-c2609ca244b3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506374 Dec 15 13:43:53.406282 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 478/951] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:43:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:43:53.416127 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3d4eff98-67cf-4e4a-af10-6444b69b6ec2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:53.416808 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3d4eff98-67cf-4e4a-af10-6444b69b6ec2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:53.427810 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-beb14927-d4df-4678-88c5-ce98b011a9d7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:53.428221 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-beb14927-d4df-4678-88c5-ce98b011a9d7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:53.434264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-beb14927-d4df-4678-88c5-ce98b011a9d7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:53.434720 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-beb14927-d4df-4678-88c5-ce98b011a9d7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:53.435764 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-beb14927-d4df-4678-88c5-ce98b011a9d7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:53.435929 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-beb14927-d4df-4678-88c5-ce98b011a9d7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:53.470081 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3d4eff98-67cf-4e4a-af10-6444b69b6ec2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:53.480530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3d4eff98-67cf-4e4a-af10-6444b69b6ec2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1217 microversion: 2.1 time: 0.067983 Dec 15 13:43:53.481704 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 474/952] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:53 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:53.556381 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5faf59a0-e81c-480b-9f7f-f1e2f0c7e8c2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:53.557506 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5faf59a0-e81c-480b-9f7f-f1e2f0c7e8c2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:53.563659 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5faf59a0-e81c-480b-9f7f-f1e2f0c7e8c2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:53.564199 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5faf59a0-e81c-480b-9f7f-f1e2f0c7e8c2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:53.565056 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5faf59a0-e81c-480b-9f7f-f1e2f0c7e8c2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:53.565577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5faf59a0-e81c-480b-9f7f-f1e2f0c7e8c2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:53.573356 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-beb14927-d4df-4678-88c5-ce98b011a9d7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:53.582894 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-beb14927-d4df-4678-88c5-ce98b011a9d7 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.159205 Dec 15 13:43:53.583622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 479/953] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:53 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:53.705383 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-5faf59a0-e81c-480b-9f7f-f1e2f0c7e8c2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:53.713709 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5faf59a0-e81c-480b-9f7f-f1e2f0c7e8c2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1364 microversion: 2.1 time: 0.160955 Dec 15 13:43:53.714571 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 475/954] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:53 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:54.498963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e5a69df0-01c9-45e8-b778-55f13481b1c8 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:54.500104 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e5a69df0-01c9-45e8-b778-55f13481b1c8 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:54.506934 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e5a69df0-01c9-45e8-b778-55f13481b1c8 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:54.507516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e5a69df0-01c9-45e8-b778-55f13481b1c8 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:54.508468 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e5a69df0-01c9-45e8-b778-55f13481b1c8 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:54.509115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e5a69df0-01c9-45e8-b778-55f13481b1c8 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:54.584143 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e5a69df0-01c9-45e8-b778-55f13481b1c8 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:54.591425 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e5a69df0-01c9-45e8-b778-55f13481b1c8 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1275 microversion: 2.1 time: 0.096390 Dec 15 13:43:54.592142 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 480/955] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:54 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:54.599863 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8154069f-0159-4cea-bde9-b71f334fad47 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:54.600804 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8154069f-0159-4cea-bde9-b71f334fad47 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:54.607833 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8154069f-0159-4cea-bde9-b71f334fad47 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:54.608280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8154069f-0159-4cea-bde9-b71f334fad47 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:54.609072 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8154069f-0159-4cea-bde9-b71f334fad47 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:54.609514 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8154069f-0159-4cea-bde9-b71f334fad47 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:54.731281 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b69ff5e8-0779-4732-aede-c0921f668316 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:54.731805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b69ff5e8-0779-4732-aede-c0921f668316 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:54.738911 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b69ff5e8-0779-4732-aede-c0921f668316 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:54.739210 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b69ff5e8-0779-4732-aede-c0921f668316 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:54.739944 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b69ff5e8-0779-4732-aede-c0921f668316 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:54.740171 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b69ff5e8-0779-4732-aede-c0921f668316 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:54.885881 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-8154069f-0159-4cea-bde9-b71f334fad47 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:54.893508 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8154069f-0159-4cea-bde9-b71f334fad47 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.297219 Dec 15 13:43:54.894396 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 476/956] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:54 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:55.017213 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b69ff5e8-0779-4732-aede-c0921f668316 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:55.025433 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b69ff5e8-0779-4732-aede-c0921f668316 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1364 microversion: 2.1 time: 0.297936 Dec 15 13:43:55.026066 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 481/957] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:54 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:55.611199 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d3eaa4aa-4057-47d6-a297-7da23c2f3d05 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:55.612063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d3eaa4aa-4057-47d6-a297-7da23c2f3d05 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:55.620126 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d3eaa4aa-4057-47d6-a297-7da23c2f3d05 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:55.620585 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d3eaa4aa-4057-47d6-a297-7da23c2f3d05 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:55.621424 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d3eaa4aa-4057-47d6-a297-7da23c2f3d05 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:55.621950 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d3eaa4aa-4057-47d6-a297-7da23c2f3d05 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:55.814125 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-d3eaa4aa-4057-47d6-a297-7da23c2f3d05 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:55.821237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d3eaa4aa-4057-47d6-a297-7da23c2f3d05 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1317 microversion: 2.1 time: 0.213960 Dec 15 13:43:55.821813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 477/958] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:55 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:55.889225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-0b3e9360-20f1-4697-875b-4e5c24317df4 req-c63e34e1-9623-456d-8f8b-fb27cb1d2640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81fc6f7a-2650-4c34-9b54-87088afc6c29", "tag": "4106350f-2509-402b-9cb0-c09b3f11c36e"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:55.891653 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:55.891653 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:43:55.899571 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-0b3e9360-20f1-4697-875b-4e5c24317df4 req-c63e34e1-9623-456d-8f8b-fb27cb1d2640 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:55.900012 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-0b3e9360-20f1-4697-875b-4e5c24317df4 req-c63e34e1-9623-456d-8f8b-fb27cb1d2640 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:55.910300 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c13b7ce1-6024-4a65-be02-52d50fea44ec tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:55.910908 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c13b7ce1-6024-4a65-be02-52d50fea44ec tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:55.912286 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-0b3e9360-20f1-4697-875b-4e5c24317df4 req-c63e34e1-9623-456d-8f8b-fb27cb1d2640 service nova] Creating event network-changed:4106350f-2509-402b-9cb0-c09b3f11c36e for instance 81fc6f7a-2650-4c34-9b54-87088afc6c29 on hv-cinder-81322 Dec 15 13:43:55.916899 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c13b7ce1-6024-4a65-be02-52d50fea44ec tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:55.917106 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-0b3e9360-20f1-4697-875b-4e5c24317df4 req-c63e34e1-9623-456d-8f8b-fb27cb1d2640 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031633 Dec 15 13:43:55.917576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 482/959] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:55.917991 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c13b7ce1-6024-4a65-be02-52d50fea44ec tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:55.918891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c13b7ce1-6024-4a65-be02-52d50fea44ec tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:55.919740 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c13b7ce1-6024-4a65-be02-52d50fea44ec tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:56.044294 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-54d8140e-8da7-47ef-87d2-f592bf8e932c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:56.045208 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-54d8140e-8da7-47ef-87d2-f592bf8e932c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:56.052521 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54d8140e-8da7-47ef-87d2-f592bf8e932c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:56.053180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54d8140e-8da7-47ef-87d2-f592bf8e932c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:56.054083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54d8140e-8da7-47ef-87d2-f592bf8e932c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:56.054585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-54d8140e-8da7-47ef-87d2-f592bf8e932c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:56.417675 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c13b7ce1-6024-4a65-be02-52d50fea44ec tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:56.425503 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c13b7ce1-6024-4a65-be02-52d50fea44ec tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.518771 Dec 15 13:43:56.426089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 478/960] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:55 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:56.544703 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-54d8140e-8da7-47ef-87d2-f592bf8e932c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:56.551932 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-54d8140e-8da7-47ef-87d2-f592bf8e932c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1364 microversion: 2.1 time: 0.512104 Dec 15 13:43:56.552597 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 483/961] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:56 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1364 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:56.838232 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6441502b-7bd3-4b43-9ecc-05aa07b74247 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:56.838888 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6441502b-7bd3-4b43-9ecc-05aa07b74247 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:56.846231 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6441502b-7bd3-4b43-9ecc-05aa07b74247 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:56.846675 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6441502b-7bd3-4b43-9ecc-05aa07b74247 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:56.847682 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6441502b-7bd3-4b43-9ecc-05aa07b74247 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:56.848115 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6441502b-7bd3-4b43-9ecc-05aa07b74247 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:57.127216 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6441502b-7bd3-4b43-9ecc-05aa07b74247 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:57.134634 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6441502b-7bd3-4b43-9ecc-05aa07b74247 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1317 microversion: 2.1 time: 0.300187 Dec 15 13:43:57.135201 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 479/962] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:56 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:57.442018 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c4d2fe79-bb03-43ad-aefd-05f2814b5fe8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:57.442612 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c4d2fe79-bb03-43ad-aefd-05f2814b5fe8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:57.448805 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c4d2fe79-bb03-43ad-aefd-05f2814b5fe8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:57.449255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c4d2fe79-bb03-43ad-aefd-05f2814b5fe8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:57.450068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c4d2fe79-bb03-43ad-aefd-05f2814b5fe8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:57.450502 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c4d2fe79-bb03-43ad-aefd-05f2814b5fe8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:57.568273 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3e0d7c39-4382-4748-ae39-878593b79dba tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:57.568975 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3e0d7c39-4382-4748-ae39-878593b79dba tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:57.574767 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3e0d7c39-4382-4748-ae39-878593b79dba tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:57.575283 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3e0d7c39-4382-4748-ae39-878593b79dba tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:57.576140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3e0d7c39-4382-4748-ae39-878593b79dba tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:57.576637 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3e0d7c39-4382-4748-ae39-878593b79dba tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:57.588969 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c4d2fe79-bb03-43ad-aefd-05f2814b5fe8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:57.597030 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c4d2fe79-bb03-43ad-aefd-05f2814b5fe8 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.158764 Dec 15 13:43:57.597591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 484/963] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:57 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:57.713921 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-3e0d7c39-4382-4748-ae39-878593b79dba tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:57.721359 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3e0d7c39-4382-4748-ae39-878593b79dba tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1364 microversion: 2.1 time: 0.156795 Dec 15 13:43:57.721955 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 480/964] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:57 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:58.098177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-68f52419-e394-4dbd-be00-9067526b4f36 req-e61c4e4c-222a-4d5e-a531-82492105e487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0d7fb7-7dbd-4a9f-9366-a551a0899d91", "name": "network-vif-plugged", "status": "completed", "tag": "7cd7dbfc-bd2e-4f55-898d-aa1bc487bb07"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:43:58.099741 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:43:58.099741 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:43:58.106929 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-68f52419-e394-4dbd-be00-9067526b4f36 req-e61c4e4c-222a-4d5e-a531-82492105e487 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:58.107374 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-68f52419-e394-4dbd-be00-9067526b4f36 req-e61c4e4c-222a-4d5e-a531-82492105e487 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:58.119657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-68f52419-e394-4dbd-be00-9067526b4f36 req-e61c4e4c-222a-4d5e-a531-82492105e487 service nova] Creating event network-vif-plugged:7cd7dbfc-bd2e-4f55-898d-aa1bc487bb07 for instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 on hv-cinder-81322 Dec 15 13:43:58.124620 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-68f52419-e394-4dbd-be00-9067526b4f36 req-e61c4e4c-222a-4d5e-a531-82492105e487 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030686 Dec 15 13:43:58.125627 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 485/965] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:43:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:43:58.151750 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fe60de82-bd1a-4909-9370-72151d1a858e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:58.152964 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fe60de82-bd1a-4909-9370-72151d1a858e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:58.160192 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fe60de82-bd1a-4909-9370-72151d1a858e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:58.160636 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fe60de82-bd1a-4909-9370-72151d1a858e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:58.161645 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fe60de82-bd1a-4909-9370-72151d1a858e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:58.162113 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-fe60de82-bd1a-4909-9370-72151d1a858e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:58.344182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fe60de82-bd1a-4909-9370-72151d1a858e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:58.351958 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fe60de82-bd1a-4909-9370-72151d1a858e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1317 microversion: 2.1 time: 0.203782 Dec 15 13:43:58.352528 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 481/966] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:58 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:58.615153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-58699a88-467e-4851-9f6b-d78d9636cc58 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:58.615994 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-58699a88-467e-4851-9f6b-d78d9636cc58 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:58.622160 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-58699a88-467e-4851-9f6b-d78d9636cc58 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:58.622603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-58699a88-467e-4851-9f6b-d78d9636cc58 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:58.623390 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-58699a88-467e-4851-9f6b-d78d9636cc58 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:58.623822 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-58699a88-467e-4851-9f6b-d78d9636cc58 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:58.738840 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e7609c70-23f2-41f6-ba60-5bc92573d6f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:58.739443 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e7609c70-23f2-41f6-ba60-5bc92573d6f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:58.745338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e7609c70-23f2-41f6-ba60-5bc92573d6f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:58.745786 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e7609c70-23f2-41f6-ba60-5bc92573d6f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:58.746583 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e7609c70-23f2-41f6-ba60-5bc92573d6f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:58.747010 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e7609c70-23f2-41f6-ba60-5bc92573d6f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:58.765930 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-58699a88-467e-4851-9f6b-d78d9636cc58 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:58.774288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-58699a88-467e-4851-9f6b-d78d9636cc58 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.164242 Dec 15 13:43:58.774851 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 486/967] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:58 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:58.882773 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e7609c70-23f2-41f6-ba60-5bc92573d6f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:58.890053 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e7609c70-23f2-41f6-ba60-5bc92573d6f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1364 microversion: 2.1 time: 0.155433 Dec 15 13:43:58.890604 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 482/968] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:58 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:43:59.373321 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-608456a6-c16c-47d6-83d5-8a665a359f68 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:59.373993 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-608456a6-c16c-47d6-83d5-8a665a359f68 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:59.380449 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-608456a6-c16c-47d6-83d5-8a665a359f68 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:59.380890 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-608456a6-c16c-47d6-83d5-8a665a359f68 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:59.381657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-608456a6-c16c-47d6-83d5-8a665a359f68 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:59.382110 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-608456a6-c16c-47d6-83d5-8a665a359f68 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:59.521116 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-608456a6-c16c-47d6-83d5-8a665a359f68 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:59.528341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-608456a6-c16c-47d6-83d5-8a665a359f68 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1317 microversion: 2.1 time: 0.158891 Dec 15 13:43:59.528898 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 487/969] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:59 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:43:59.791447 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1776a7e2-2a46-46d9-98a2-b8c2ee623aaf tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:59.792048 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1776a7e2-2a46-46d9-98a2-b8c2ee623aaf tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:59.799169 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1776a7e2-2a46-46d9-98a2-b8c2ee623aaf tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:59.799621 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1776a7e2-2a46-46d9-98a2-b8c2ee623aaf tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:59.800404 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1776a7e2-2a46-46d9-98a2-b8c2ee623aaf tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:59.800839 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1776a7e2-2a46-46d9-98a2-b8c2ee623aaf tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:59.907784 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-08b29d71-8eb6-41d1-9d1f-8461ec2b45ff tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:43:59.908314 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-08b29d71-8eb6-41d1-9d1f-8461ec2b45ff tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:43:59.914567 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-08b29d71-8eb6-41d1-9d1f-8461ec2b45ff tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:59.915007 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-08b29d71-8eb6-41d1-9d1f-8461ec2b45ff tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:59.915931 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-08b29d71-8eb6-41d1-9d1f-8461ec2b45ff tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:43:59.916365 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-08b29d71-8eb6-41d1-9d1f-8461ec2b45ff tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:43:59.944760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-1776a7e2-2a46-46d9-98a2-b8c2ee623aaf tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:43:59.952320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1776a7e2-2a46-46d9-98a2-b8c2ee623aaf tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.164490 Dec 15 13:43:59.953002 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 483/970] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:59 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:00.054314 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-08b29d71-8eb6-41d1-9d1f-8461ec2b45ff tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:00.061502 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-08b29d71-8eb6-41d1-9d1f-8461ec2b45ff tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1550 microversion: 2.1 time: 0.158118 Dec 15 13:44:00.062166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 488/971] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:43:59 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:44:00.077847 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-01bf15a6-e68b-416e-b361-279adb1396fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:00.078340 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-01bf15a6-e68b-416e-b361-279adb1396fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:00.084552 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-01bf15a6-e68b-416e-b361-279adb1396fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:00.085006 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-01bf15a6-e68b-416e-b361-279adb1396fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:00.085823 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-01bf15a6-e68b-416e-b361-279adb1396fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:00.086266 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-01bf15a6-e68b-416e-b361-279adb1396fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:00.169607 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-01bf15a6-e68b-416e-b361-279adb1396fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095495 Dec 15 13:44:00.170235 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 484/972] 10.222.0.83 () {58 vars in 1274 bytes} [Wed Dec 15 13:44:00 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:00.220014 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-9e2c37fd-539b-4028-994f-dc9e2a8e6870 req-4c0f5fbc-eac9-4e19-ad91-93876d9e9c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9aceb1-a94c-418d-bbb3-bcc4b14f482e", "name": "network-vif-plugged", "status": "completed", "tag": "ad5d037e-580b-4432-81b5-1d7c3583d89d"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:00.222368 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:00.222368 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:44:00.229513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-9e2c37fd-539b-4028-994f-dc9e2a8e6870 req-4c0f5fbc-eac9-4e19-ad91-93876d9e9c3e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:00.230112 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-9e2c37fd-539b-4028-994f-dc9e2a8e6870 req-4c0f5fbc-eac9-4e19-ad91-93876d9e9c3e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:00.241803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-9e2c37fd-539b-4028-994f-dc9e2a8e6870 req-4c0f5fbc-eac9-4e19-ad91-93876d9e9c3e service nova] Creating event network-vif-plugged:ad5d037e-580b-4432-81b5-1d7c3583d89d for instance 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e on hv-cinder-81322 Dec 15 13:44:00.246806 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-9e2c37fd-539b-4028-994f-dc9e2a8e6870 req-4c0f5fbc-eac9-4e19-ad91-93876d9e9c3e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Dec 15 13:44:00.247737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 489/973] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:00.544223 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6f79d717-b74c-4b1f-ba34-a08944507aaa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:00.545092 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6f79d717-b74c-4b1f-ba34-a08944507aaa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:00.551337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6f79d717-b74c-4b1f-ba34-a08944507aaa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:00.551920 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6f79d717-b74c-4b1f-ba34-a08944507aaa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:00.552832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6f79d717-b74c-4b1f-ba34-a08944507aaa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:00.553372 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6f79d717-b74c-4b1f-ba34-a08944507aaa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:00.697801 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-6f79d717-b74c-4b1f-ba34-a08944507aaa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:00.707530 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6f79d717-b74c-4b1f-ba34-a08944507aaa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1317 microversion: 2.1 time: 0.166898 Dec 15 13:44:00.709029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 485/974] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:00 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:00.969536 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c47a0093-5a22-46ee-bf6b-5079f088f6e4 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:00.970361 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c47a0093-5a22-46ee-bf6b-5079f088f6e4 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:00.976720 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c47a0093-5a22-46ee-bf6b-5079f088f6e4 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:00.977174 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c47a0093-5a22-46ee-bf6b-5079f088f6e4 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:00.978023 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c47a0093-5a22-46ee-bf6b-5079f088f6e4 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:00.978466 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c47a0093-5a22-46ee-bf6b-5079f088f6e4 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:01.128739 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c47a0093-5a22-46ee-bf6b-5079f088f6e4 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:01.137284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c47a0093-5a22-46ee-bf6b-5079f088f6e4 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1267 microversion: 2.1 time: 0.172119 Dec 15 13:44:01.138515 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 490/975] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:00 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:01.159279 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4e86ee9b-9c34-44ed-bbfc-233d9ac1a3f9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:01.160471 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4e86ee9b-9c34-44ed-bbfc-233d9ac1a3f9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:01.161957 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-b9548d1c-3202-44ef-9eda-f22a40a7a4b7 req-045b5e73-64a4-4daf-91ab-6607b59e721a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd0d7fb7-7dbd-4a9f-9366-a551a0899d91", "tag": "7cd7dbfc-bd2e-4f55-898d-aa1bc487bb07"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:01.163603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:01.163603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:44:01.166971 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4e86ee9b-9c34-44ed-bbfc-233d9ac1a3f9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:01.167424 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4e86ee9b-9c34-44ed-bbfc-233d9ac1a3f9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:01.168209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4e86ee9b-9c34-44ed-bbfc-233d9ac1a3f9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:01.168647 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4e86ee9b-9c34-44ed-bbfc-233d9ac1a3f9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:01.170776 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-b9548d1c-3202-44ef-9eda-f22a40a7a4b7 req-045b5e73-64a4-4daf-91ab-6607b59e721a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:01.171336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-b9548d1c-3202-44ef-9eda-f22a40a7a4b7 req-045b5e73-64a4-4daf-91ab-6607b59e721a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:01.183976 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-b9548d1c-3202-44ef-9eda-f22a40a7a4b7 req-045b5e73-64a4-4daf-91ab-6607b59e721a service nova] Creating event network-changed:7cd7dbfc-bd2e-4f55-898d-aa1bc487bb07 for instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 on hv-cinder-81322 Dec 15 13:44:01.187709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-b9548d1c-3202-44ef-9eda-f22a40a7a4b7 req-045b5e73-64a4-4daf-91ab-6607b59e721a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029356 Dec 15 13:44:01.189083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 491/976] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:01.251672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4e86ee9b-9c34-44ed-bbfc-233d9ac1a3f9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.095600 Dec 15 13:44:01.252992 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 486/977] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:01 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:01.726230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-5c7fbb11-e899-44d1-9c60-77fd62b99c58 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:01.727452 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-5c7fbb11-e899-44d1-9c60-77fd62b99c58 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:01.734150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5c7fbb11-e899-44d1-9c60-77fd62b99c58 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:01.734723 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5c7fbb11-e899-44d1-9c60-77fd62b99c58 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:01.735610 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5c7fbb11-e899-44d1-9c60-77fd62b99c58 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:01.736119 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-5c7fbb11-e899-44d1-9c60-77fd62b99c58 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:01.900834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-5c7fbb11-e899-44d1-9c60-77fd62b99c58 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:01.909806 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-5c7fbb11-e899-44d1-9c60-77fd62b99c58 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1317 microversion: 2.1 time: 0.187699 Dec 15 13:44:01.919393 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 492/978] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:01 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:02.155561 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-da10b357-2c99-48cd-95d2-6672efcba285 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:02.156314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-da10b357-2c99-48cd-95d2-6672efcba285 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:02.163206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-da10b357-2c99-48cd-95d2-6672efcba285 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.163859 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-da10b357-2c99-48cd-95d2-6672efcba285 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:02.164462 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-da10b357-2c99-48cd-95d2-6672efcba285 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.164890 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-da10b357-2c99-48cd-95d2-6672efcba285 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:02.262912 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-eff8aa0f-7de1-4399-891b-76230717866f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:02.264578 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-eff8aa0f-7de1-4399-891b-76230717866f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:02.272410 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-eff8aa0f-7de1-4399-891b-76230717866f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.273074 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-eff8aa0f-7de1-4399-891b-76230717866f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:02.274480 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-eff8aa0f-7de1-4399-891b-76230717866f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.275083 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-eff8aa0f-7de1-4399-891b-76230717866f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:02.330821 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-da10b357-2c99-48cd-95d2-6672efcba285 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:02.345103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-eff8aa0f-7de1-4399-891b-76230717866f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.086343 Dec 15 13:44:02.345325 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-da10b357-2c99-48cd-95d2-6672efcba285 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1454 microversion: 2.1 time: 0.192925 Dec 15 13:44:02.346877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 493/979] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:02 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:44:02.356908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-46a8426b-1e93-4107-9f23-492832e0e168 req-c9edaf89-24a1-4021-8765-bf0f930aaf50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81fc6f7a-2650-4c34-9b54-87088afc6c29", "name": "network-vif-plugged", "status": "completed", "tag": "4106350f-2509-402b-9cb0-c09b3f11c36e"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:02.359670 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:02.359670 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:44:02.360436 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 487/980] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:02 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1454 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:02.365373 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-bbbd12de-35c6-497e-b600-6d7b8cba5ce9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:02.366317 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-bbbd12de-35c6-497e-b600-6d7b8cba5ce9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:02.371636 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-46a8426b-1e93-4107-9f23-492832e0e168 req-c9edaf89-24a1-4021-8765-bf0f930aaf50 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.372180 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-46a8426b-1e93-4107-9f23-492832e0e168 req-c9edaf89-24a1-4021-8765-bf0f930aaf50 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:02.374236 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bbbd12de-35c6-497e-b600-6d7b8cba5ce9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.374935 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bbbd12de-35c6-497e-b600-6d7b8cba5ce9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:02.376454 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bbbd12de-35c6-497e-b600-6d7b8cba5ce9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.377112 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-bbbd12de-35c6-497e-b600-6d7b8cba5ce9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:02.389014 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-46a8426b-1e93-4107-9f23-492832e0e168 req-c9edaf89-24a1-4021-8765-bf0f930aaf50 service nova] Creating event network-vif-plugged:4106350f-2509-402b-9cb0-c09b3f11c36e for instance 81fc6f7a-2650-4c34-9b54-87088afc6c29 on hv-cinder-81322 Dec 15 13:44:02.395752 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-46a8426b-1e93-4107-9f23-492832e0e168 req-c9edaf89-24a1-4021-8765-bf0f930aaf50 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045669 Dec 15 13:44:02.396436 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 494/981] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:02.551818 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-bbbd12de-35c6-497e-b600-6d7b8cba5ce9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:02.560410 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-bbbd12de-35c6-497e-b600-6d7b8cba5ce9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1454 microversion: 2.1 time: 0.198445 Dec 15 13:44:02.561166 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 488/982] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:02 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:02.928889 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-431537f0-0a50-4c51-8aeb-15f30266ee69 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:02.929697 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-431537f0-0a50-4c51-8aeb-15f30266ee69 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:02.936722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-431537f0-0a50-4c51-8aeb-15f30266ee69 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.937171 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-431537f0-0a50-4c51-8aeb-15f30266ee69 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:02.938117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-431537f0-0a50-4c51-8aeb-15f30266ee69 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:02.938726 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-431537f0-0a50-4c51-8aeb-15f30266ee69 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:03.179008 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-431537f0-0a50-4c51-8aeb-15f30266ee69 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:03.187338 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-431537f0-0a50-4c51-8aeb-15f30266ee69 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1317 microversion: 2.1 time: 0.262961 Dec 15 13:44:03.187931 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 495/983] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:02 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:03.366269 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f9e36c5c-36e9-44ad-9212-574f2624f7dc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:03.367349 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f9e36c5c-36e9-44ad-9212-574f2624f7dc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:03.377270 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f9e36c5c-36e9-44ad-9212-574f2624f7dc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:03.377726 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f9e36c5c-36e9-44ad-9212-574f2624f7dc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:03.378565 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f9e36c5c-36e9-44ad-9212-574f2624f7dc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:03.379002 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f9e36c5c-36e9-44ad-9212-574f2624f7dc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:03.460051 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f9e36c5c-36e9-44ad-9212-574f2624f7dc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.098687 Dec 15 13:44:03.463199 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 489/984] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:03 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:03.595152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-ac65f117-1a7a-4bd9-84b5-233919579c6f req-0d65892b-59ac-4986-8c4f-97931a7ad8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cbd3cfd-7384-46fd-8231-1016f1c0cdc6", "tag": "eb15e4a2-9577-4f05-b3d6-86804d162658"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:03.597937 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6becb167-dd42-426d-922b-b9b1e70a137b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:03.598577 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6becb167-dd42-426d-922b-b9b1e70a137b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:03.602524 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:03.602524 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:44:03.611558 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6becb167-dd42-426d-922b-b9b1e70a137b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:03.617079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-ac65f117-1a7a-4bd9-84b5-233919579c6f req-0d65892b-59ac-4986-8c4f-97931a7ad8f5 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:03.617079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-ac65f117-1a7a-4bd9-84b5-233919579c6f req-0d65892b-59ac-4986-8c4f-97931a7ad8f5 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:03.617831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6becb167-dd42-426d-922b-b9b1e70a137b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:03.618801 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6becb167-dd42-426d-922b-b9b1e70a137b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:03.619381 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6becb167-dd42-426d-922b-b9b1e70a137b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:03.644118 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-ac65f117-1a7a-4bd9-84b5-233919579c6f req-0d65892b-59ac-4986-8c4f-97931a7ad8f5 service nova] Creating event network-changed:eb15e4a2-9577-4f05-b3d6-86804d162658 for instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 on hv-cinder-81322 Dec 15 13:44:03.657860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-ac65f117-1a7a-4bd9-84b5-233919579c6f req-0d65892b-59ac-4986-8c4f-97931a7ad8f5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060277 Dec 15 13:44:03.659175 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 490/985] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:03.667754 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6becb167-dd42-426d-922b-b9b1e70a137b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:44:03.766219 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6becb167-dd42-426d-922b-b9b1e70a137b tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 204 len: 0 microversion: 2.1 time: 0.178976 Dec 15 13:44:03.767396 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 496/986] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:44:03 2021] DELETE /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:44:03.785319 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c5e39749-03c7-463f-b2a9-3d5fb9f07af2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:03.786343 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c5e39749-03c7-463f-b2a9-3d5fb9f07af2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:03.793366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5e39749-03c7-463f-b2a9-3d5fb9f07af2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:03.794241 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5e39749-03c7-463f-b2a9-3d5fb9f07af2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:03.795253 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5e39749-03c7-463f-b2a9-3d5fb9f07af2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:03.795696 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5e39749-03c7-463f-b2a9-3d5fb9f07af2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:04.116961 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c5e39749-03c7-463f-b2a9-3d5fb9f07af2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:04.125917 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c5e39749-03c7-463f-b2a9-3d5fb9f07af2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1569 microversion: 2.1 time: 0.348085 Dec 15 13:44:04.127127 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 491/987] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:03 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1569 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:04.207574 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8455b75d-1ba7-42e1-bd95-8c4c8dbd0780 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:04.208353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8455b75d-1ba7-42e1-bd95-8c4c8dbd0780 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:04.215687 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8455b75d-1ba7-42e1-bd95-8c4c8dbd0780 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:04.216274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8455b75d-1ba7-42e1-bd95-8c4c8dbd0780 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:04.217189 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8455b75d-1ba7-42e1-bd95-8c4c8dbd0780 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:04.217796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8455b75d-1ba7-42e1-bd95-8c4c8dbd0780 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:04.471810 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ebd14f06-5856-450c-81eb-1c96ceea10f3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:04.472734 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ebd14f06-5856-450c-81eb-1c96ceea10f3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:04.479462 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ebd14f06-5856-450c-81eb-1c96ceea10f3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:04.479908 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ebd14f06-5856-450c-81eb-1c96ceea10f3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:04.480733 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ebd14f06-5856-450c-81eb-1c96ceea10f3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:04.481164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ebd14f06-5856-450c-81eb-1c96ceea10f3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:04.544803 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ebd14f06-5856-450c-81eb-1c96ceea10f3 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.077344 Dec 15 13:44:04.548370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 492/988] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:04 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:44:04.839897 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8455b75d-1ba7-42e1-bd95-8c4c8dbd0780 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:04.847909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8455b75d-1ba7-42e1-bd95-8c4c8dbd0780 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1507 microversion: 2.1 time: 0.647014 Dec 15 13:44:04.848584 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 497/989] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:04 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:05.146259 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0aaaaf8b-4f25-4412-b5be-470ee30103c2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:05.147418 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0aaaaf8b-4f25-4412-b5be-470ee30103c2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:05.154879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0aaaaf8b-4f25-4412-b5be-470ee30103c2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:05.155367 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0aaaaf8b-4f25-4412-b5be-470ee30103c2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:05.156268 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0aaaaf8b-4f25-4412-b5be-470ee30103c2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:05.156787 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0aaaaf8b-4f25-4412-b5be-470ee30103c2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:05.224365 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-7650a1e5-579b-42da-b30d-6810ac7ecdc4 req-ba22f181-711a-4dc5-9c17-3563e0b4a438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9aceb1-a94c-418d-bbb3-bcc4b14f482e", "tag": "ad5d037e-580b-4432-81b5-1d7c3583d89d"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:05.226477 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:05.226477 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:44:05.237136 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-7650a1e5-579b-42da-b30d-6810ac7ecdc4 req-ba22f181-711a-4dc5-9c17-3563e0b4a438 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:05.237861 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-7650a1e5-579b-42da-b30d-6810ac7ecdc4 req-ba22f181-711a-4dc5-9c17-3563e0b4a438 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:05.248906 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-7650a1e5-579b-42da-b30d-6810ac7ecdc4 req-ba22f181-711a-4dc5-9c17-3563e0b4a438 service nova] Creating event network-changed:ad5d037e-580b-4432-81b5-1d7c3583d89d for instance 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e on hv-cinder-81322 Dec 15 13:44:05.254896 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-7650a1e5-579b-42da-b30d-6810ac7ecdc4 req-ba22f181-711a-4dc5-9c17-3563e0b4a438 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Dec 15 13:44:05.255760 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 498/990] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:05.361965 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0aaaaf8b-4f25-4412-b5be-470ee30103c2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:05.369833 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0aaaaf8b-4f25-4412-b5be-470ee30103c2 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1450 microversion: 2.1 time: 0.229131 Dec 15 13:44:05.370470 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 493/991] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:05 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1450 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:05.557571 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cdb87cdf-9621-4525-a04f-f00b3504cb85 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:05.558978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cdb87cdf-9621-4525-a04f-f00b3504cb85 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:05.566728 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cdb87cdf-9621-4525-a04f-f00b3504cb85 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:05.568815 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cdb87cdf-9621-4525-a04f-f00b3504cb85 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:05.569722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cdb87cdf-9621-4525-a04f-f00b3504cb85 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:05.570418 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cdb87cdf-9621-4525-a04f-f00b3504cb85 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:05.678000 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cdb87cdf-9621-4525-a04f-f00b3504cb85 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.125156 Dec 15 13:44:05.678638 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 499/992] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:05 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:06.191647 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6d34e6dd-eb4f-44b0-a6f5-606d45f2751f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22ced487-aeef-4b44-a00c-eb30d7a3f542"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:06.192728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6d34e6dd-eb4f-44b0-a6f5-606d45f2751f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:06.199569 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6d34e6dd-eb4f-44b0-a6f5-606d45f2751f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:06.200383 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6d34e6dd-eb4f-44b0-a6f5-606d45f2751f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:06.201374 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6d34e6dd-eb4f-44b0-a6f5-606d45f2751f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:06.201847 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6d34e6dd-eb4f-44b0-a6f5-606d45f2751f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:06.394060 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3d662647-8be5-4bba-bd6c-fcc221746b86 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:06.395670 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3d662647-8be5-4bba-bd6c-fcc221746b86 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:06.405230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3d662647-8be5-4bba-bd6c-fcc221746b86 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:06.405827 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3d662647-8be5-4bba-bd6c-fcc221746b86 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:06.407078 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3d662647-8be5-4bba-bd6c-fcc221746b86 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:06.408654 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3d662647-8be5-4bba-bd6c-fcc221746b86 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:06.498152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6d34e6dd-eb4f-44b0-a6f5-606d45f2751f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310287 Dec 15 13:44:06.498926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 494/993] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:44:06 2021] POST /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:06.692390 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-316c2731-5f6e-4e45-8bdb-d5f39d449734 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:06.693617 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-316c2731-5f6e-4e45-8bdb-d5f39d449734 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:06.705332 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-316c2731-5f6e-4e45-8bdb-d5f39d449734 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:06.707079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-316c2731-5f6e-4e45-8bdb-d5f39d449734 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:06.709362 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-316c2731-5f6e-4e45-8bdb-d5f39d449734 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:06.710010 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-316c2731-5f6e-4e45-8bdb-d5f39d449734 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:06.815897 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-316c2731-5f6e-4e45-8bdb-d5f39d449734 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.129897 Dec 15 13:44:06.819363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 495/994] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:06 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:06.830002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3d662647-8be5-4bba-bd6c-fcc221746b86 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa045c5aa324b8a8e3f3d83437c706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0b248663174800af3db2a34d92f6b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:06.837952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3d662647-8be5-4bba-bd6c-fcc221746b86 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 200 len: 1450 microversion: 2.1 time: 0.452450 Dec 15 13:44:06.838527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 500/995] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:06 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 1450 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:07.272377 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-ad5d4d34-7a27-4810-9a74-41a09d5d0e82 req-31be923c-60a6-4ee4-bb3f-f1f6da2749ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbd3cfd-7384-46fd-8231-1016f1c0cdc6", "name": "network-vif-deleted", "tag": "eb15e4a2-9577-4f05-b3d6-86804d162658"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:07.275492 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:07.275492 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:44:07.284738 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-ad5d4d34-7a27-4810-9a74-41a09d5d0e82 req-31be923c-60a6-4ee4-bb3f-f1f6da2749ed service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:07.285998 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-ad5d4d34-7a27-4810-9a74-41a09d5d0e82 req-31be923c-60a6-4ee4-bb3f-f1f6da2749ed service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:07.300363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-ad5d4d34-7a27-4810-9a74-41a09d5d0e82 req-31be923c-60a6-4ee4-bb3f-f1f6da2749ed service nova] Creating event network-vif-deleted:eb15e4a2-9577-4f05-b3d6-86804d162658 for instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 on hv-cinder-81322 Dec 15 13:44:07.307628 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-ad5d4d34-7a27-4810-9a74-41a09d5d0e82 req-31be923c-60a6-4ee4-bb3f-f1f6da2749ed service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041239 Dec 15 13:44:07.308267 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 496/996] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:07.828935 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ca20715d-e368-4fd8-8b4f-fb934aaf086c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:07.830627 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ca20715d-e368-4fd8-8b4f-fb934aaf086c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:07.838996 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ca20715d-e368-4fd8-8b4f-fb934aaf086c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:07.839634 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ca20715d-e368-4fd8-8b4f-fb934aaf086c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:07.841138 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ca20715d-e368-4fd8-8b4f-fb934aaf086c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:07.842176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ca20715d-e368-4fd8-8b4f-fb934aaf086c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:07.856750 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:07.857537 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] [instance: 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:07.866207 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:07.866997 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:07.867814 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:07.868988 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:07.884921 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] HTTP exception thrown: Instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 could not be found. Dec 15 13:44:07.885545 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Returning 404 to user: Instance 9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:44:07.886520 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-feec8c82-5303-4e4d-8336-feeb1f5c8d9c tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6" status: 404 len: 111 microversion: 2.1 time: 0.034379 Dec 15 13:44:07.887105 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 497/997] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:07 2021] GET /compute/v2.1/servers/9cbd3cfd-7384-46fd-8231-1016f1c0cdc6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:44:07.920195 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ca20715d-e368-4fd8-8b4f-fb934aaf086c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.096809 Dec 15 13:44:07.920823 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 501/998] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:07 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:44:08.056756 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8111120d-23f6-43a5-8633-506dcc8eac71 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] Calling method '.version_select at 0x7fd78f6e8e50>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:08.077857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8111120d-23f6-43a5-8633-506dcc8eac71 tempest-TestShelveInstance-2129646236 tempest-TestShelveInstance-2129646236-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1688072311" status: 202 len: 0 microversion: 2.1 time: 0.025162 Dec 15 13:44:08.078673 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 498/999] 10.222.0.83 () {58 vars in 1253 bytes} [Wed Dec 15 13:44:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1688072311 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:44:08.933258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-191f160a-f44c-43ed-a58a-4858a5d10158 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:08.934453 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-191f160a-f44c-43ed-a58a-4858a5d10158 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:08.944208 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-191f160a-f44c-43ed-a58a-4858a5d10158 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:08.944655 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-191f160a-f44c-43ed-a58a-4858a5d10158 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:08.945460 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-191f160a-f44c-43ed-a58a-4858a5d10158 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:08.945936 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-191f160a-f44c-43ed-a58a-4858a5d10158 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:09.042146 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-191f160a-f44c-43ed-a58a-4858a5d10158 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.113280 Dec 15 13:44:09.043411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 502/1000] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:08 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:10.056654 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-72be4ea7-9167-4342-949a-e29fff0e713c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:10.057662 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-72be4ea7-9167-4342-949a-e29fff0e713c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:10.065279 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72be4ea7-9167-4342-949a-e29fff0e713c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:10.065860 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72be4ea7-9167-4342-949a-e29fff0e713c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:10.066745 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72be4ea7-9167-4342-949a-e29fff0e713c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:10.067264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-72be4ea7-9167-4342-949a-e29fff0e713c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:10.145469 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-72be4ea7-9167-4342-949a-e29fff0e713c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.093181 Dec 15 13:44:10.148580 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 499/1001] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:10 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:44:11.156836 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b999426e-bf96-482a-b4ba-be818c4b3c4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:11.158437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b999426e-bf96-482a-b4ba-be818c4b3c4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:11.165188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b999426e-bf96-482a-b4ba-be818c4b3c4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:11.165627 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b999426e-bf96-482a-b4ba-be818c4b3c4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:11.166513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b999426e-bf96-482a-b4ba-be818c4b3c4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:11.166936 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b999426e-bf96-482a-b4ba-be818c4b3c4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:11.238439 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b999426e-bf96-482a-b4ba-be818c4b3c4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.085436 Dec 15 13:44:11.239067 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 503/1002] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:11 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:44:12.249276 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-145e4568-d30d-472e-a8a8-21f4ba11ccf4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:12.250351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-145e4568-d30d-472e-a8a8-21f4ba11ccf4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:12.258656 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-145e4568-d30d-472e-a8a8-21f4ba11ccf4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:12.259404 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-145e4568-d30d-472e-a8a8-21f4ba11ccf4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:12.260414 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-145e4568-d30d-472e-a8a8-21f4ba11ccf4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:12.261028 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-145e4568-d30d-472e-a8a8-21f4ba11ccf4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:12.338453 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-145e4568-d30d-472e-a8a8-21f4ba11ccf4 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.093090 Dec 15 13:44:12.339129 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 500/1003] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:12 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:13.349663 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-00c21982-210d-41cb-abf8-c612a77b1f45 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:13.350813 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-00c21982-210d-41cb-abf8-c612a77b1f45 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:13.358713 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-00c21982-210d-41cb-abf8-c612a77b1f45 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:13.359225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-00c21982-210d-41cb-abf8-c612a77b1f45 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:13.360046 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-00c21982-210d-41cb-abf8-c612a77b1f45 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:13.360706 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-00c21982-210d-41cb-abf8-c612a77b1f45 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:13.463418 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-00c21982-210d-41cb-abf8-c612a77b1f45 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.118364 Dec 15 13:44:13.466625 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 504/1004] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:13 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:14.005427 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22ced487-aeef-4b44-a00c-eb30d7a3f542"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:14.007565 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:14.015792 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:14.018103 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:14.019073 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:14.019640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:14.111703 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] HTTP exception thrown: Invalid volume: volume 22ced487-aeef-4b44-a00c-eb30d7a3f542 is already attached to instances: 81fc6f7a-2650-4c34-9b54-87088afc6c29 Dec 15 13:44:14.112296 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Returning 400 to user: Invalid volume: volume 22ced487-aeef-4b44-a00c-eb30d7a3f542 is already attached to instances: 81fc6f7a-2650-4c34-9b54-87088afc6c29 {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:44:14.113125 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6bfb6646-7f40-4fcf-a9d6-d8aa9aaec4af tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112603 Dec 15 13:44:14.113667 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 501/1005] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:44:13 2021] POST /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 13:44:14.210600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a8ae9604-cbc5-4303-b15f-5882e9c5c82a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:14.211367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a8ae9604-cbc5-4303-b15f-5882e9c5c82a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:14.220544 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a8ae9604-cbc5-4303-b15f-5882e9c5c82a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:14.221494 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a8ae9604-cbc5-4303-b15f-5882e9c5c82a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:14.222576 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a8ae9604-cbc5-4303-b15f-5882e9c5c82a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:14.223223 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a8ae9604-cbc5-4303-b15f-5882e9c5c82a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:14.348271 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-a8ae9604-cbc5-4303-b15f-5882e9c5c82a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lazy-loading 'services' on Instance uuid 81fc6f7a-2650-4c34-9b54-87088afc6c29 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:44:14.444764 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a8ae9604-cbc5-4303-b15f-5882e9c5c82a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments/22ced487-aeef-4b44-a00c-eb30d7a3f542" status: 202 len: 0 microversion: 2.1 time: 0.239966 Dec 15 13:44:14.446415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 505/1006] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:44:14 2021] DELETE /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments/22ced487-aeef-4b44-a00c-eb30d7a3f542 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:44:14.455304 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e1a7d967-1510-4a1d-88a0-5b186de55154 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:14.456597 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e1a7d967-1510-4a1d-88a0-5b186de55154 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:14.464799 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e1a7d967-1510-4a1d-88a0-5b186de55154 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:14.465786 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e1a7d967-1510-4a1d-88a0-5b186de55154 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:14.466761 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e1a7d967-1510-4a1d-88a0-5b186de55154 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:14.467353 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e1a7d967-1510-4a1d-88a0-5b186de55154 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:14.477450 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-42fa1102-e1d7-4eec-8fb9-e5c5395b55ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:14.478548 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-42fa1102-e1d7-4eec-8fb9-e5c5395b55ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:14.490857 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42fa1102-e1d7-4eec-8fb9-e5c5395b55ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:14.491575 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42fa1102-e1d7-4eec-8fb9-e5c5395b55ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:14.492561 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42fa1102-e1d7-4eec-8fb9-e5c5395b55ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:14.493309 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-42fa1102-e1d7-4eec-8fb9-e5c5395b55ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:14.530816 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e1a7d967-1510-4a1d-88a0-5b186de55154 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079574 Dec 15 13:44:14.533915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 502/1007] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:44:14 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:14.596388 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-42fa1102-e1d7-4eec-8fb9-e5c5395b55ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.122247 Dec 15 13:44:14.600179 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 506/1008] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:14 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:44:15.545056 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e9c560b8-971c-40ae-a929-39dea62693c2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:15.546281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e9c560b8-971c-40ae-a929-39dea62693c2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:15.553192 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9c560b8-971c-40ae-a929-39dea62693c2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:15.553645 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9c560b8-971c-40ae-a929-39dea62693c2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:15.554496 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9c560b8-971c-40ae-a929-39dea62693c2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:15.554942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9c560b8-971c-40ae-a929-39dea62693c2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:15.589829 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e9c560b8-971c-40ae-a929-39dea62693c2 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048786 Dec 15 13:44:15.596362 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 503/1009] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:44:15 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:15.608718 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-115fa39d-78f5-4abd-ad82-5b2723f26d00 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:15.609721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-115fa39d-78f5-4abd-ad82-5b2723f26d00 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:15.617655 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-115fa39d-78f5-4abd-ad82-5b2723f26d00 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:15.618150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-115fa39d-78f5-4abd-ad82-5b2723f26d00 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:15.618955 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-115fa39d-78f5-4abd-ad82-5b2723f26d00 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:15.619394 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-115fa39d-78f5-4abd-ad82-5b2723f26d00 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:15.701313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-115fa39d-78f5-4abd-ad82-5b2723f26d00 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 14 microversion: 2.1 time: 0.097176 Dec 15 13:44:15.702284 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 507/1010] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:15 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:44:15.765001 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-307370684", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "645914b7-eef4-444f-ad03-9e082234296c"}]}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:15.816159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.network.neutron [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] validate_networks() for [('645914b7-eef4-444f-ad03-9e082234296c', None, None, None, None, None)] {{(pid=122611) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:44:16.193733 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Flavor limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:44:16.194186 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Image limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:44:16.194710 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Flavor pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:44:16.195118 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Image pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:44:16.195526 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:44:16.203938 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:16.204384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:16.205194 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:16.205624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:16.221486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Getting quotas for project 5d663b994c834c358d7a268a08eac730. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:44:16.225328 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Getting quotas for user c5f1e439f9aa45cdbdc0155405423942 and project 5d663b994c834c358d7a268a08eac730. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:44:16.236182 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Going to run 1 instances... {{(pid=122611) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:44:16.238455 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:44:16.280678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0a2b33e2-edd2-469b-89c0-4043a1638a99 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519307 Dec 15 13:44:16.281303 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 504/1011] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:44:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:44:16.291499 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-71ea68b2-cfe1-4a1b-a3fe-2bb891d2a746 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:16.292181 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-71ea68b2-cfe1-4a1b-a3fe-2bb891d2a746 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:16.348504 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-71ea68b2-cfe1-4a1b-a3fe-2bb891d2a746 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:16.354854 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-71ea68b2-cfe1-4a1b-a3fe-2bb891d2a746 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1217 microversion: 2.1 time: 0.067291 Dec 15 13:44:16.355856 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 508/1012] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:16 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:16.714024 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9ca3fde8-3b70-44f3-9069-381c8fdd5119 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:16.715047 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9ca3fde8-3b70-44f3-9069-381c8fdd5119 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:16.725172 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9ca3fde8-3b70-44f3-9069-381c8fdd5119 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:16.725630 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9ca3fde8-3b70-44f3-9069-381c8fdd5119 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:16.726442 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9ca3fde8-3b70-44f3-9069-381c8fdd5119 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:16.726879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9ca3fde8-3b70-44f3-9069-381c8fdd5119 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:16.822275 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9ca3fde8-3b70-44f3-9069-381c8fdd5119 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 6986 microversion: 2.1 time: 0.112396 Dec 15 13:44:16.822925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 505/1013] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:16 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 6986 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:17.372166 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b117ed1a-c33f-416c-93d3-f2577bcf35ee tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:17.373843 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b117ed1a-c33f-416c-93d3-f2577bcf35ee tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:17.381994 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b117ed1a-c33f-416c-93d3-f2577bcf35ee tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:17.382583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b117ed1a-c33f-416c-93d3-f2577bcf35ee tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:17.383410 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b117ed1a-c33f-416c-93d3-f2577bcf35ee tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:17.384040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b117ed1a-c33f-416c-93d3-f2577bcf35ee tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:17.451507 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b117ed1a-c33f-416c-93d3-f2577bcf35ee tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:17.460498 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b117ed1a-c33f-416c-93d3-f2577bcf35ee tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1287 microversion: 2.1 time: 0.091887 Dec 15 13:44:17.461176 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 509/1014] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:17 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:17.834913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7d86de72-5f75-40c3-8102-408d2641867e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:17.835981 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7d86de72-5f75-40c3-8102-408d2641867e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:17.842907 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d86de72-5f75-40c3-8102-408d2641867e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:17.843358 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d86de72-5f75-40c3-8102-408d2641867e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:17.844139 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d86de72-5f75-40c3-8102-408d2641867e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:17.844602 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7d86de72-5f75-40c3-8102-408d2641867e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:17.939768 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7d86de72-5f75-40c3-8102-408d2641867e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 12971 microversion: 2.1 time: 0.108157 Dec 15 13:44:17.940531 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 506/1015] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:17 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 12971 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:18.477928 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6f700097-3355-49bf-b9a0-e0fcb636bb35 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:18.478531 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6f700097-3355-49bf-b9a0-e0fcb636bb35 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:18.484644 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6f700097-3355-49bf-b9a0-e0fcb636bb35 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:18.485082 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6f700097-3355-49bf-b9a0-e0fcb636bb35 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:18.486523 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6f700097-3355-49bf-b9a0-e0fcb636bb35 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:18.486952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6f700097-3355-49bf-b9a0-e0fcb636bb35 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:18.618913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-f2324fb4-e83e-4ef0-9456-c5d752a5394b req-6b7a3ddb-482c-4798-92c7-36f9108e4131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283e3280-6661-4451-82ec-979b371ab94f", "tag": "8f8e5976-3ec3-457e-8855-37c83b545ce9"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:18.620400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:18.620400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:44:18.636251 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-f2324fb4-e83e-4ef0-9456-c5d752a5394b req-6b7a3ddb-482c-4798-92c7-36f9108e4131 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:18.636698 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-f2324fb4-e83e-4ef0-9456-c5d752a5394b req-6b7a3ddb-482c-4798-92c7-36f9108e4131 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:18.648613 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-f2324fb4-e83e-4ef0-9456-c5d752a5394b req-6b7a3ddb-482c-4798-92c7-36f9108e4131 service nova] Creating event network-changed:8f8e5976-3ec3-457e-8855-37c83b545ce9 for instance 283e3280-6661-4451-82ec-979b371ab94f on hv-cinder-81322 Dec 15 13:44:18.653372 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-f2324fb4-e83e-4ef0-9456-c5d752a5394b req-6b7a3ddb-482c-4798-92c7-36f9108e4131 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038520 Dec 15 13:44:18.654327 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 507/1016] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:44:18.729579 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-6f700097-3355-49bf-b9a0-e0fcb636bb35 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:18.737607 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6f700097-3355-49bf-b9a0-e0fcb636bb35 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1317 microversion: 2.1 time: 0.263222 Dec 15 13:44:18.738230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 510/1017] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:18 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:18.953128 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c5ba3d00-eaff-4849-b84c-17df22b945b8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:18.954193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c5ba3d00-eaff-4849-b84c-17df22b945b8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:18.960744 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5ba3d00-eaff-4849-b84c-17df22b945b8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:18.961193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5ba3d00-eaff-4849-b84c-17df22b945b8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:18.962025 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5ba3d00-eaff-4849-b84c-17df22b945b8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:18.962453 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c5ba3d00-eaff-4849-b84c-17df22b945b8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:19.073343 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c5ba3d00-eaff-4849-b84c-17df22b945b8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 17159 microversion: 2.1 time: 0.125038 Dec 15 13:44:19.074063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 508/1018] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:18 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 17159 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:44:19.755344 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f4f06c26-413e-43ae-81d5-ef4d7bc023ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:19.755951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f4f06c26-413e-43ae-81d5-ef4d7bc023ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:19.762183 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f4f06c26-413e-43ae-81d5-ef4d7bc023ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:19.762626 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f4f06c26-413e-43ae-81d5-ef4d7bc023ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:19.763397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f4f06c26-413e-43ae-81d5-ef4d7bc023ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:19.763829 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f4f06c26-413e-43ae-81d5-ef4d7bc023ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:19.894682 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f4f06c26-413e-43ae-81d5-ef4d7bc023ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:19.901733 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f4f06c26-413e-43ae-81d5-ef4d7bc023ec tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1317 microversion: 2.1 time: 0.150528 Dec 15 13:44:19.902326 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 511/1019] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:19 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:20.085913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-dca86c00-d302-4254-b2bf-50e1ce24acb0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:20.086903 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-dca86c00-d302-4254-b2bf-50e1ce24acb0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:20.093564 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dca86c00-d302-4254-b2bf-50e1ce24acb0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:20.094041 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dca86c00-d302-4254-b2bf-50e1ce24acb0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:20.094809 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dca86c00-d302-4254-b2bf-50e1ce24acb0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:20.095501 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dca86c00-d302-4254-b2bf-50e1ce24acb0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:20.190789 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-dca86c00-d302-4254-b2bf-50e1ce24acb0 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 17914 microversion: 2.1 time: 0.108717 Dec 15 13:44:20.191335 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 509/1020] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:20 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 17914 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:20.918608 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-016c1e46-b41a-4bc5-b103-5ef930415e1a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:20.919153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-016c1e46-b41a-4bc5-b103-5ef930415e1a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:20.925258 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-016c1e46-b41a-4bc5-b103-5ef930415e1a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:20.925699 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-016c1e46-b41a-4bc5-b103-5ef930415e1a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:20.926498 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-016c1e46-b41a-4bc5-b103-5ef930415e1a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:20.926929 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-016c1e46-b41a-4bc5-b103-5ef930415e1a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:21.054423 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-016c1e46-b41a-4bc5-b103-5ef930415e1a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:21.061538 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-016c1e46-b41a-4bc5-b103-5ef930415e1a tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1317 microversion: 2.1 time: 0.146683 Dec 15 13:44:21.062125 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 512/1021] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:20 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:21.201721 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-677fbc92-3fed-442b-bda2-bfe5fe1a5b01 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:21.202659 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-677fbc92-3fed-442b-bda2-bfe5fe1a5b01 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:21.211625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-677fbc92-3fed-442b-bda2-bfe5fe1a5b01 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:21.212079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-677fbc92-3fed-442b-bda2-bfe5fe1a5b01 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:21.212851 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-677fbc92-3fed-442b-bda2-bfe5fe1a5b01 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:21.213280 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-677fbc92-3fed-442b-bda2-bfe5fe1a5b01 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:21.320790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-677fbc92-3fed-442b-bda2-bfe5fe1a5b01 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 19399 microversion: 2.1 time: 0.123070 Dec 15 13:44:21.321405 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 510/1022] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:21 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 19399 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:44:22.078844 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2890c9a4-17e7-4e6d-9f2a-9efa83a46792 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:22.079518 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2890c9a4-17e7-4e6d-9f2a-9efa83a46792 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:22.085854 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2890c9a4-17e7-4e6d-9f2a-9efa83a46792 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:22.086306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2890c9a4-17e7-4e6d-9f2a-9efa83a46792 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:22.087096 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2890c9a4-17e7-4e6d-9f2a-9efa83a46792 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:22.087532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2890c9a4-17e7-4e6d-9f2a-9efa83a46792 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:22.216100 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-2890c9a4-17e7-4e6d-9f2a-9efa83a46792 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:22.223439 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2890c9a4-17e7-4e6d-9f2a-9efa83a46792 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1317 microversion: 2.1 time: 0.148237 Dec 15 13:44:22.224007 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 513/1023] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:22 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:22.332620 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-26082197-57d4-4281-9c3d-8de84ba279df tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:22.333610 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-26082197-57d4-4281-9c3d-8de84ba279df tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:22.340619 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26082197-57d4-4281-9c3d-8de84ba279df tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:22.341079 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26082197-57d4-4281-9c3d-8de84ba279df tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:22.341881 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26082197-57d4-4281-9c3d-8de84ba279df tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:22.342309 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26082197-57d4-4281-9c3d-8de84ba279df tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:22.432434 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-26082197-57d4-4281-9c3d-8de84ba279df tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 21929 microversion: 2.1 time: 0.103606 Dec 15 13:44:22.433080 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 511/1024] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:22 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 21929 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:23.241024 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9c03ff31-ea7b-4cbb-b3fd-a67183892058 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:23.241632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9c03ff31-ea7b-4cbb-b3fd-a67183892058 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:23.247909 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c03ff31-ea7b-4cbb-b3fd-a67183892058 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:23.248352 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c03ff31-ea7b-4cbb-b3fd-a67183892058 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:23.249121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c03ff31-ea7b-4cbb-b3fd-a67183892058 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:23.249554 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9c03ff31-ea7b-4cbb-b3fd-a67183892058 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:23.377820 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9c03ff31-ea7b-4cbb-b3fd-a67183892058 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:23.384974 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9c03ff31-ea7b-4cbb-b3fd-a67183892058 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1317 microversion: 2.1 time: 0.147586 Dec 15 13:44:23.385525 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 514/1025] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:23 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:23.444356 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ebfb4e5f-ae6c-4802-86e8-e5cca9a2753b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:23.445351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ebfb4e5f-ae6c-4802-86e8-e5cca9a2753b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:23.452120 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ebfb4e5f-ae6c-4802-86e8-e5cca9a2753b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:23.452562 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ebfb4e5f-ae6c-4802-86e8-e5cca9a2753b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:23.453321 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ebfb4e5f-ae6c-4802-86e8-e5cca9a2753b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:23.453749 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ebfb4e5f-ae6c-4802-86e8-e5cca9a2753b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:23.540281 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ebfb4e5f-ae6c-4802-86e8-e5cca9a2753b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 22979 microversion: 2.1 time: 0.099650 Dec 15 13:44:23.540839 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 512/1026] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:23 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 22979 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:24.222441 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-7e25afc2-cc6b-4518-b6ef-9d3e31f7e731 req-6f6bf52f-f608-44e8-96ce-2f6ff29ceb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283e3280-6661-4451-82ec-979b371ab94f", "name": "network-vif-plugged", "status": "completed", "tag": "8f8e5976-3ec3-457e-8855-37c83b545ce9"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:24.223721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:24.223721 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:44:24.231002 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-7e25afc2-cc6b-4518-b6ef-9d3e31f7e731 req-6f6bf52f-f608-44e8-96ce-2f6ff29ceb3d service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:24.231427 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-7e25afc2-cc6b-4518-b6ef-9d3e31f7e731 req-6f6bf52f-f608-44e8-96ce-2f6ff29ceb3d service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:24.244835 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-7e25afc2-cc6b-4518-b6ef-9d3e31f7e731 req-6f6bf52f-f608-44e8-96ce-2f6ff29ceb3d service nova] Creating event network-vif-plugged:8f8e5976-3ec3-457e-8855-37c83b545ce9 for instance 283e3280-6661-4451-82ec-979b371ab94f on hv-cinder-81322 Dec 15 13:44:24.249877 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-7e25afc2-cc6b-4518-b6ef-9d3e31f7e731 req-6f6bf52f-f608-44e8-96ce-2f6ff29ceb3d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032035 Dec 15 13:44:24.250479 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 515/1027] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:24.402609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4ebc9745-1eb5-4e8a-8db1-a9b1c2afa001 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:24.403338 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4ebc9745-1eb5-4e8a-8db1-a9b1c2afa001 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:24.411479 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4ebc9745-1eb5-4e8a-8db1-a9b1c2afa001 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:24.411931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4ebc9745-1eb5-4e8a-8db1-a9b1c2afa001 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:24.412727 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4ebc9745-1eb5-4e8a-8db1-a9b1c2afa001 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:24.413163 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4ebc9745-1eb5-4e8a-8db1-a9b1c2afa001 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:24.552825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a89a749c-f46a-4591-adf2-2d90f1550f5a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:24.553884 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a89a749c-f46a-4591-adf2-2d90f1550f5a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:24.559968 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a89a749c-f46a-4591-adf2-2d90f1550f5a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:24.560412 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a89a749c-f46a-4591-adf2-2d90f1550f5a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:24.561201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a89a749c-f46a-4591-adf2-2d90f1550f5a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:24.561630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a89a749c-f46a-4591-adf2-2d90f1550f5a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:24.579817 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-4ebc9745-1eb5-4e8a-8db1-a9b1c2afa001 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:24.587367 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4ebc9745-1eb5-4e8a-8db1-a9b1c2afa001 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1317 microversion: 2.1 time: 0.188932 Dec 15 13:44:24.587832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 513/1028] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:24 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:24.806775 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a89a749c-f46a-4591-adf2-2d90f1550f5a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 23795 microversion: 2.1 time: 0.258303 Dec 15 13:44:24.807322 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 516/1029] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:24 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 23795 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 13:44:25.604100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9730c3a2-3e0c-4bce-b55b-2c4d379ac9a3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:25.604736 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9730c3a2-3e0c-4bce-b55b-2c4d379ac9a3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:25.610926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9730c3a2-3e0c-4bce-b55b-2c4d379ac9a3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:25.611375 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9730c3a2-3e0c-4bce-b55b-2c4d379ac9a3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:25.612173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9730c3a2-3e0c-4bce-b55b-2c4d379ac9a3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:25.612606 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9730c3a2-3e0c-4bce-b55b-2c4d379ac9a3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:25.741096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9730c3a2-3e0c-4bce-b55b-2c4d379ac9a3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:25.748202 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9730c3a2-3e0c-4bce-b55b-2c4d379ac9a3 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1317 microversion: 2.1 time: 0.147813 Dec 15 13:44:25.748750 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 514/1030] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:25 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:25.819492 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b23cb960-3a9b-417d-94a7-c8cc9c519277 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:25.820476 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b23cb960-3a9b-417d-94a7-c8cc9c519277 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:25.827306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b23cb960-3a9b-417d-94a7-c8cc9c519277 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:25.827756 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b23cb960-3a9b-417d-94a7-c8cc9c519277 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:25.828530 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b23cb960-3a9b-417d-94a7-c8cc9c519277 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:25.828965 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b23cb960-3a9b-417d-94a7-c8cc9c519277 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:25.924447 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b23cb960-3a9b-417d-94a7-c8cc9c519277 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 24328 microversion: 2.1 time: 0.108165 Dec 15 13:44:25.924989 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 517/1031] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:25 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 24328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:26.765425 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-dc20a07a-476e-43e5-98c6-3371668f9dbd tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:26.766169 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-dc20a07a-476e-43e5-98c6-3371668f9dbd tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:26.772980 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dc20a07a-476e-43e5-98c6-3371668f9dbd tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:26.773429 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dc20a07a-476e-43e5-98c6-3371668f9dbd tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:26.774234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dc20a07a-476e-43e5-98c6-3371668f9dbd tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:26.774674 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dc20a07a-476e-43e5-98c6-3371668f9dbd tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:26.902779 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-dc20a07a-476e-43e5-98c6-3371668f9dbd tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:26.910113 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-dc20a07a-476e-43e5-98c6-3371668f9dbd tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1507 microversion: 2.1 time: 0.148278 Dec 15 13:44:26.910611 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 515/1032] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:26 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:26.935999 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b4138ec7-f14a-4f79-9162-7b95f05ff8c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:26.937050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b4138ec7-f14a-4f79-9162-7b95f05ff8c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:26.944301 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4138ec7-f14a-4f79-9162-7b95f05ff8c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:26.944746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4138ec7-f14a-4f79-9162-7b95f05ff8c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:26.945520 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4138ec7-f14a-4f79-9162-7b95f05ff8c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:26.945988 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b4138ec7-f14a-4f79-9162-7b95f05ff8c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:27.054681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b4138ec7-f14a-4f79-9162-7b95f05ff8c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 25155 microversion: 2.1 time: 0.122380 Dec 15 13:44:27.055331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 518/1033] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:26 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 25155 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:28.066157 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e4fde874-6740-4fcc-932d-ee84157563ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:28.067072 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e4fde874-6740-4fcc-932d-ee84157563ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:28.073319 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e4fde874-6740-4fcc-932d-ee84157563ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:28.073777 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e4fde874-6740-4fcc-932d-ee84157563ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:28.074568 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e4fde874-6740-4fcc-932d-ee84157563ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:28.075005 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e4fde874-6740-4fcc-932d-ee84157563ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:28.164437 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e4fde874-6740-4fcc-932d-ee84157563ce tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 26155 microversion: 2.1 time: 0.101891 Dec 15 13:44:28.165058 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 516/1034] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:28 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 26155 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:28.217437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d0ea904d-7d6b-4720-999e-389612af852c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba89b533-6017-4bd1-b5a3-9b43fe52edfc"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:28.218525 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d0ea904d-7d6b-4720-999e-389612af852c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:28.225895 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d0ea904d-7d6b-4720-999e-389612af852c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:28.226341 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d0ea904d-7d6b-4720-999e-389612af852c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:28.227104 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d0ea904d-7d6b-4720-999e-389612af852c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:28.227532 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d0ea904d-7d6b-4720-999e-389612af852c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:28.464113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d0ea904d-7d6b-4720-999e-389612af852c tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "POST /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250606 Dec 15 13:44:28.464728 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 519/1035] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:44:28 2021] POST /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:29.178416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-55e86d27-6c2f-4672-accf-449ac66c1c4e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:29.179855 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-55e86d27-6c2f-4672-accf-449ac66c1c4e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:29.187942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-55e86d27-6c2f-4672-accf-449ac66c1c4e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:29.188389 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-55e86d27-6c2f-4672-accf-449ac66c1c4e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:29.189164 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-55e86d27-6c2f-4672-accf-449ac66c1c4e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:29.189746 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-55e86d27-6c2f-4672-accf-449ac66c1c4e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:29.293507 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-55e86d27-6c2f-4672-accf-449ac66c1c4e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 27030 microversion: 2.1 time: 0.120273 Dec 15 13:44:29.294081 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 517/1036] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:29 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 27030 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:30.306103 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-323617fc-cd01-40f4-8529-e17c6ce1b0f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:30.307061 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-323617fc-cd01-40f4-8529-e17c6ce1b0f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:30.313347 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-323617fc-cd01-40f4-8529-e17c6ce1b0f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:30.313820 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-323617fc-cd01-40f4-8529-e17c6ce1b0f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:30.315238 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-323617fc-cd01-40f4-8529-e17c6ce1b0f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:30.315676 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-323617fc-cd01-40f4-8529-e17c6ce1b0f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:30.406527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-323617fc-cd01-40f4-8529-e17c6ce1b0f8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 27524 microversion: 2.1 time: 0.105001 Dec 15 13:44:30.407149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 520/1037] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:30 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 27524 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:31.418524 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-02bb0078-d152-4539-ba90-16aef0dccc3b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:31.419517 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-02bb0078-d152-4539-ba90-16aef0dccc3b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:31.426986 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-02bb0078-d152-4539-ba90-16aef0dccc3b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:31.427433 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-02bb0078-d152-4539-ba90-16aef0dccc3b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:31.428204 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-02bb0078-d152-4539-ba90-16aef0dccc3b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:31.428639 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-02bb0078-d152-4539-ba90-16aef0dccc3b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:31.526684 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-02bb0078-d152-4539-ba90-16aef0dccc3b tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 27812 microversion: 2.1 time: 0.112041 Dec 15 13:44:31.527337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 518/1038] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:31 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 27812 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:32.538293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3dbf0dfa-ef1c-4b8b-b993-59957bfb5800 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:32.539189 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3dbf0dfa-ef1c-4b8b-b993-59957bfb5800 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:32.546051 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3dbf0dfa-ef1c-4b8b-b993-59957bfb5800 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:32.546490 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3dbf0dfa-ef1c-4b8b-b993-59957bfb5800 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:32.547263 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3dbf0dfa-ef1c-4b8b-b993-59957bfb5800 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:32.547689 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3dbf0dfa-ef1c-4b8b-b993-59957bfb5800 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:32.655293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3dbf0dfa-ef1c-4b8b-b993-59957bfb5800 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28177 microversion: 2.1 time: 0.120986 Dec 15 13:44:32.655940 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 521/1039] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:32 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28177 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:33.667826 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c472d068-ff50-427d-8897-30735d45e804 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:33.668814 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c472d068-ff50-427d-8897-30735d45e804 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:33.675712 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c472d068-ff50-427d-8897-30735d45e804 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:33.676152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c472d068-ff50-427d-8897-30735d45e804 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:33.676913 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c472d068-ff50-427d-8897-30735d45e804 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:33.677337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c472d068-ff50-427d-8897-30735d45e804 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:33.776442 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c472d068-ff50-427d-8897-30735d45e804 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28179 microversion: 2.1 time: 0.112435 Dec 15 13:44:33.777078 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 519/1040] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:33 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:34.788549 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-dde366b2-a428-4dc8-9aa4-5fe4c3f1873d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:34.789597 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-dde366b2-a428-4dc8-9aa4-5fe4c3f1873d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:34.796693 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dde366b2-a428-4dc8-9aa4-5fe4c3f1873d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:34.797150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dde366b2-a428-4dc8-9aa4-5fe4c3f1873d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:34.797966 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dde366b2-a428-4dc8-9aa4-5fe4c3f1873d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:34.798402 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-dde366b2-a428-4dc8-9aa4-5fe4c3f1873d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:34.884963 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-dde366b2-a428-4dc8-9aa4-5fe4c3f1873d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28179 microversion: 2.1 time: 0.100391 Dec 15 13:44:34.885612 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 522/1041] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:34 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:35.899332 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d2f4a858-6a2e-42ad-9b20-edfbfa5365c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:35.900393 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d2f4a858-6a2e-42ad-9b20-edfbfa5365c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:35.907448 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d2f4a858-6a2e-42ad-9b20-edfbfa5365c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:35.907891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d2f4a858-6a2e-42ad-9b20-edfbfa5365c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:35.909229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d2f4a858-6a2e-42ad-9b20-edfbfa5365c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:35.909660 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d2f4a858-6a2e-42ad-9b20-edfbfa5365c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:36.013730 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1f80033f-e4f6-4a3b-abda-cf1c219b1240 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:36.014323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1f80033f-e4f6-4a3b-abda-cf1c219b1240 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:36.021152 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1f80033f-e4f6-4a3b-abda-cf1c219b1240 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:36.021595 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1f80033f-e4f6-4a3b-abda-cf1c219b1240 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:36.022407 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1f80033f-e4f6-4a3b-abda-cf1c219b1240 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:36.022841 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1f80033f-e4f6-4a3b-abda-cf1c219b1240 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:36.029301 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d2f4a858-6a2e-42ad-9b20-edfbfa5365c7 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28204 microversion: 2.1 time: 0.133998 Dec 15 13:44:36.033835 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 520/1042] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:35 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28204 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:36.101359 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-1f80033f-e4f6-4a3b-abda-cf1c219b1240 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lazy-loading 'services' on Instance uuid 283e3280-6661-4451-82ec-979b371ab94f {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:44:36.169961 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1f80033f-e4f6-4a3b-abda-cf1c219b1240 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f/os-volume_attachments/ba89b533-6017-4bd1-b5a3-9b43fe52edfc" status: 202 len: 0 microversion: 2.1 time: 0.160035 Dec 15 13:44:36.170540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 523/1043] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:44:36 2021] DELETE /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f/os-volume_attachments/ba89b533-6017-4bd1-b5a3-9b43fe52edfc => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 13:44:36.179946 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-34f0e057-f92c-46ca-90e1-925b2c5de80f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:36.180943 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-34f0e057-f92c-46ca-90e1-925b2c5de80f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:36.188479 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-34f0e057-f92c-46ca-90e1-925b2c5de80f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:36.188976 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-34f0e057-f92c-46ca-90e1-925b2c5de80f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:36.189782 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-34f0e057-f92c-46ca-90e1-925b2c5de80f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:36.190394 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-34f0e057-f92c-46ca-90e1-925b2c5de80f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:36.220416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-34f0e057-f92c-46ca-90e1-925b2c5de80f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044545 Dec 15 13:44:36.222063 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 521/1044] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:44:36 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:37.045062 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7ea256b1-310e-497b-a631-51cb796f0b4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:37.046799 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7ea256b1-310e-497b-a631-51cb796f0b4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:37.055591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7ea256b1-310e-497b-a631-51cb796f0b4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:37.056035 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7ea256b1-310e-497b-a631-51cb796f0b4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:37.056837 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7ea256b1-310e-497b-a631-51cb796f0b4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:37.057271 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7ea256b1-310e-497b-a631-51cb796f0b4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:37.158986 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7ea256b1-310e-497b-a631-51cb796f0b4f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28467 microversion: 2.1 time: 0.120333 Dec 15 13:44:37.159651 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 524/1045] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:37 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28467 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:37.234070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-26804e9a-4b53-475d-8a28-72e0bfcf0108 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:37.234893 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-26804e9a-4b53-475d-8a28-72e0bfcf0108 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:37.243941 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26804e9a-4b53-475d-8a28-72e0bfcf0108 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:37.244854 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26804e9a-4b53-475d-8a28-72e0bfcf0108 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:37.246384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26804e9a-4b53-475d-8a28-72e0bfcf0108 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:37.246960 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26804e9a-4b53-475d-8a28-72e0bfcf0108 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:37.281542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-26804e9a-4b53-475d-8a28-72e0bfcf0108 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051696 Dec 15 13:44:37.282141 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 522/1046] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:44:37 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 15 13:44:38.170997 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c444a221-ca1b-4d52-bee7-d7e3a26dfa4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:38.171999 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c444a221-ca1b-4d52-bee7-d7e3a26dfa4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:38.179438 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c444a221-ca1b-4d52-bee7-d7e3a26dfa4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:38.179876 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c444a221-ca1b-4d52-bee7-d7e3a26dfa4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:38.180642 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c444a221-ca1b-4d52-bee7-d7e3a26dfa4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:38.181068 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c444a221-ca1b-4d52-bee7-d7e3a26dfa4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:38.264104 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c444a221-ca1b-4d52-bee7-d7e3a26dfa4c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28635 microversion: 2.1 time: 0.096800 Dec 15 13:44:38.264657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 525/1047] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:38 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28635 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:38.507790 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-7c4b6df0-309a-44ec-a2f3-d0e4e8cfb191 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:38.508268 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7c4b6df0-309a-44ec-a2f3-d0e4e8cfb191 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:38.514509 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7c4b6df0-309a-44ec-a2f3-d0e4e8cfb191 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:38.514892 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7c4b6df0-309a-44ec-a2f3-d0e4e8cfb191 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:38.515661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7c4b6df0-309a-44ec-a2f3-d0e4e8cfb191 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:38.516089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-7c4b6df0-309a-44ec-a2f3-d0e4e8cfb191 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:38.540786 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-7c4b6df0-309a-44ec-a2f3-d0e4e8cfb191 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:44:38.633379 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-7c4b6df0-309a-44ec-a2f3-d0e4e8cfb191 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 204 len: 0 microversion: 2.1 time: 0.129084 Dec 15 13:44:38.634302 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 523/1048] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:44:38 2021] DELETE /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:44:38.642869 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-3cc18d32-b4f6-401e-8b3d-7c0207ae333e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:38.643637 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-3cc18d32-b4f6-401e-8b3d-7c0207ae333e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:38.650657 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3cc18d32-b4f6-401e-8b3d-7c0207ae333e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:38.651096 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3cc18d32-b4f6-401e-8b3d-7c0207ae333e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:38.651882 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3cc18d32-b4f6-401e-8b3d-7c0207ae333e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:38.652306 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-3cc18d32-b4f6-401e-8b3d-7c0207ae333e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:38.790647 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-3cc18d32-b4f6-401e-8b3d-7c0207ae333e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:38.797953 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-3cc18d32-b4f6-401e-8b3d-7c0207ae333e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1513 microversion: 2.1 time: 0.159142 Dec 15 13:44:38.798529 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 526/1049] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:38 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:39.277030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-4aec077d-e916-4971-af3e-190e755c1a04 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:39.278058 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-4aec077d-e916-4971-af3e-190e755c1a04 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:39.284239 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4aec077d-e916-4971-af3e-190e755c1a04 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:39.284680 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4aec077d-e916-4971-af3e-190e755c1a04 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:39.285452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4aec077d-e916-4971-af3e-190e755c1a04 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:39.285920 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-4aec077d-e916-4971-af3e-190e755c1a04 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:39.358622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-4aec077d-e916-4971-af3e-190e755c1a04 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28635 microversion: 2.1 time: 0.085486 Dec 15 13:44:39.359507 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 524/1050] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:39 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28635 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:39.815625 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-cd5d2cea-634a-4b8c-8f3b-f5e0f5a6c3aa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:39.816298 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-cd5d2cea-634a-4b8c-8f3b-f5e0f5a6c3aa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:39.822526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd5d2cea-634a-4b8c-8f3b-f5e0f5a6c3aa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:39.822964 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd5d2cea-634a-4b8c-8f3b-f5e0f5a6c3aa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:39.823725 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd5d2cea-634a-4b8c-8f3b-f5e0f5a6c3aa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:39.824152 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-cd5d2cea-634a-4b8c-8f3b-f5e0f5a6c3aa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:39.951756 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-cd5d2cea-634a-4b8c-8f3b-f5e0f5a6c3aa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:39.958959 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-cd5d2cea-634a-4b8c-8f3b-f5e0f5a6c3aa tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1513 microversion: 2.1 time: 0.147038 Dec 15 13:44:39.959535 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 527/1051] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:39 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:40.371228 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-8fc5a70e-5cc2-4c3c-bf98-b259ca0e8922 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:40.372250 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-8fc5a70e-5cc2-4c3c-bf98-b259ca0e8922 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:40.379596 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8fc5a70e-5cc2-4c3c-bf98-b259ca0e8922 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:40.380046 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8fc5a70e-5cc2-4c3c-bf98-b259ca0e8922 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:40.380857 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8fc5a70e-5cc2-4c3c-bf98-b259ca0e8922 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:40.381296 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-8fc5a70e-5cc2-4c3c-bf98-b259ca0e8922 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:40.456714 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-8fc5a70e-5cc2-4c3c-bf98-b259ca0e8922 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28635 microversion: 2.1 time: 0.088787 Dec 15 13:44:40.457334 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 525/1052] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:40 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28635 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:40.979268 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-c44e44a9-2019-4575-9106-a82b8d8f3c19 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:40.980077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-c44e44a9-2019-4575-9106-a82b8d8f3c19 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:40.987699 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c44e44a9-2019-4575-9106-a82b8d8f3c19 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:40.988203 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c44e44a9-2019-4575-9106-a82b8d8f3c19 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:40.989292 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c44e44a9-2019-4575-9106-a82b8d8f3c19 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:40.990046 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-c44e44a9-2019-4575-9106-a82b8d8f3c19 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:41.346005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-c44e44a9-2019-4575-9106-a82b8d8f3c19 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:41.354211 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-c44e44a9-2019-4575-9106-a82b8d8f3c19 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 200 len: 1513 microversion: 2.1 time: 0.381238 Dec 15 13:44:41.364236 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 528/1053] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:40 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 1513 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:41.469925 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cf664bb6-17f0-4555-8f5e-0dc2eddb0bb6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:41.472380 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cf664bb6-17f0-4555-8f5e-0dc2eddb0bb6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:41.484560 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-955b89fb-d285-488b-bebe-15d423a15fd2 req-aede5784-9462-46ce-96a2-e385477aa05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283e3280-6661-4451-82ec-979b371ab94f", "name": "network-vif-deleted", "tag": "8f8e5976-3ec3-457e-8855-37c83b545ce9"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:41.486681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:41.486681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:44:41.496598 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-955b89fb-d285-488b-bebe-15d423a15fd2 req-aede5784-9462-46ce-96a2-e385477aa05c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:41.496837 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cf664bb6-17f0-4555-8f5e-0dc2eddb0bb6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:41.497266 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cf664bb6-17f0-4555-8f5e-0dc2eddb0bb6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:41.497913 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-955b89fb-d285-488b-bebe-15d423a15fd2 req-aede5784-9462-46ce-96a2-e385477aa05c service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:41.498172 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cf664bb6-17f0-4555-8f5e-0dc2eddb0bb6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:41.498779 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cf664bb6-17f0-4555-8f5e-0dc2eddb0bb6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:41.513186 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-955b89fb-d285-488b-bebe-15d423a15fd2 req-aede5784-9462-46ce-96a2-e385477aa05c service nova] Creating event network-vif-deleted:8f8e5976-3ec3-457e-8855-37c83b545ce9 for instance 283e3280-6661-4451-82ec-979b371ab94f on hv-cinder-81322 Dec 15 13:44:41.524003 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-955b89fb-d285-488b-bebe-15d423a15fd2 req-aede5784-9462-46ce-96a2-e385477aa05c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042882 Dec 15 13:44:41.524796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 529/1054] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:41.599443 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cf664bb6-17f0-4555-8f5e-0dc2eddb0bb6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28635 microversion: 2.1 time: 0.134764 Dec 15 13:44:41.600165 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 526/1055] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:41 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28635 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:42.372255 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:42.372953 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 283e3280-6661-4451-82ec-979b371ab94f] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:42.382192 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:42.382639 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:42.383422 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:42.384591 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:42.397899 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] HTTP exception thrown: Instance 283e3280-6661-4451-82ec-979b371ab94f could not be found. Dec 15 13:44:42.398483 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Returning 404 to user: Instance 283e3280-6661-4451-82ec-979b371ab94f could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:44:42.399327 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6a8790c1-d56e-43b7-985b-3de805b39e45 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f" status: 404 len: 111 microversion: 2.1 time: 0.031076 Dec 15 13:44:42.399864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 530/1056] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:42 2021] GET /compute/v2.1/servers/283e3280-6661-4451-82ec-979b371ab94f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:44:42.612109 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-db57a6c4-e427-4433-a2b6-95c2df13a00c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:42.613838 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-db57a6c4-e427-4433-a2b6-95c2df13a00c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:42.620757 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-db57a6c4-e427-4433-a2b6-95c2df13a00c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:42.621264 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-db57a6c4-e427-4433-a2b6-95c2df13a00c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:42.622071 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-db57a6c4-e427-4433-a2b6-95c2df13a00c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:42.622559 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-db57a6c4-e427-4433-a2b6-95c2df13a00c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:42.691556 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-db57a6c4-e427-4433-a2b6-95c2df13a00c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 28635 microversion: 2.1 time: 0.083402 Dec 15 13:44:42.692363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 527/1057] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:42 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 28635 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:43.534407 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-81a10f62-1ff0-4003-bef1-15ad2dfba3a4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:43.534916 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-81a10f62-1ff0-4003-bef1-15ad2dfba3a4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:43.541188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81a10f62-1ff0-4003-bef1-15ad2dfba3a4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:43.541856 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81a10f62-1ff0-4003-bef1-15ad2dfba3a4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:43.542654 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81a10f62-1ff0-4003-bef1-15ad2dfba3a4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:43.543087 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-81a10f62-1ff0-4003-bef1-15ad2dfba3a4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:43.570014 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-81a10f62-1ff0-4003-bef1-15ad2dfba3a4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:44:43.707402 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a98ec3b3-ea51-4c8e-b13a-72b5b794e011 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:43.708431 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a98ec3b3-ea51-4c8e-b13a-72b5b794e011 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:43.715662 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a98ec3b3-ea51-4c8e-b13a-72b5b794e011 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:43.716107 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a98ec3b3-ea51-4c8e-b13a-72b5b794e011 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:43.716889 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a98ec3b3-ea51-4c8e-b13a-72b5b794e011 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:43.717320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a98ec3b3-ea51-4c8e-b13a-72b5b794e011 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:43.793670 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-81a10f62-1ff0-4003-bef1-15ad2dfba3a4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 204 len: 0 microversion: 2.1 time: 0.262374 Dec 15 13:44:43.794230 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 531/1058] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:44:43 2021] DELETE /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:44:43.802591 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a98ec3b3-ea51-4c8e-b13a-72b5b794e011 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 29447 microversion: 2.1 time: 0.100752 Dec 15 13:44:43.803036 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a0382596-a6c4-4b6e-b676-b851698b8203 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:43.803551 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 528/1059] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:43 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 29447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:43.803708 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a0382596-a6c4-4b6e-b676-b851698b8203 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:43.813971 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a0382596-a6c4-4b6e-b676-b851698b8203 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:43.814409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a0382596-a6c4-4b6e-b676-b851698b8203 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:43.815188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a0382596-a6c4-4b6e-b676-b851698b8203 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:43.816299 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a0382596-a6c4-4b6e-b676-b851698b8203 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:43.953991 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-a0382596-a6c4-4b6e-b676-b851698b8203 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:43.961293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a0382596-a6c4-4b6e-b676-b851698b8203 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1513 microversion: 2.1 time: 0.162721 Dec 15 13:44:43.961864 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 532/1060] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:43 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:44:44.816933 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c970e1f5-0fd3-403f-9241-8b6785221e10 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:44.817972 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c970e1f5-0fd3-403f-9241-8b6785221e10 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:44.824795 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c970e1f5-0fd3-403f-9241-8b6785221e10 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:44.825244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c970e1f5-0fd3-403f-9241-8b6785221e10 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:44.826054 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c970e1f5-0fd3-403f-9241-8b6785221e10 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:44.826489 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c970e1f5-0fd3-403f-9241-8b6785221e10 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:44.906842 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c970e1f5-0fd3-403f-9241-8b6785221e10 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 31123 microversion: 2.1 time: 0.093697 Dec 15 13:44:44.907416 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 529/1061] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:44 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 31123 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:44.978852 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-1da7a6e3-4ec6-450b-8b4b-7b942b44d84f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:44.979501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-1da7a6e3-4ec6-450b-8b4b-7b942b44d84f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:44.985976 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1da7a6e3-4ec6-450b-8b4b-7b942b44d84f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:44.986416 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1da7a6e3-4ec6-450b-8b4b-7b942b44d84f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:44.987204 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1da7a6e3-4ec6-450b-8b4b-7b942b44d84f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:44.987683 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-1da7a6e3-4ec6-450b-8b4b-7b942b44d84f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:45.116305 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-1da7a6e3-4ec6-450b-8b4b-7b942b44d84f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:45.123603 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-1da7a6e3-4ec6-450b-8b4b-7b942b44d84f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1513 microversion: 2.1 time: 0.148888 Dec 15 13:44:45.124147 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 533/1062] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:44 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:45.919955 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-1904ad62-cc4f-44a1-9c0b-6547077839f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:45.920882 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-1904ad62-cc4f-44a1-9c0b-6547077839f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:45.928720 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1904ad62-cc4f-44a1-9c0b-6547077839f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:45.929169 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1904ad62-cc4f-44a1-9c0b-6547077839f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:45.929993 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1904ad62-cc4f-44a1-9c0b-6547077839f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:45.930437 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-1904ad62-cc4f-44a1-9c0b-6547077839f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:46.002201 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-1904ad62-cc4f-44a1-9c0b-6547077839f5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 32519 microversion: 2.1 time: 0.086319 Dec 15 13:44:46.006628 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 530/1063] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:45 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 32519 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:46.089808 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-0cdef79f-fa3a-47c1-8b6f-93a4af84fd85 req-601bba27-a9cb-4224-b142-424dec4ad58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81fc6f7a-2650-4c34-9b54-87088afc6c29", "name": "network-vif-deleted", "tag": "4106350f-2509-402b-9cb0-c09b3f11c36e"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:46.091334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:46.091334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:44:46.100275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-0cdef79f-fa3a-47c1-8b6f-93a4af84fd85 req-601bba27-a9cb-4224-b142-424dec4ad58e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:46.100720 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-0cdef79f-fa3a-47c1-8b6f-93a4af84fd85 req-601bba27-a9cb-4224-b142-424dec4ad58e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:46.112064 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-0cdef79f-fa3a-47c1-8b6f-93a4af84fd85 req-601bba27-a9cb-4224-b142-424dec4ad58e service nova] Creating event network-vif-deleted:4106350f-2509-402b-9cb0-c09b3f11c36e for instance 81fc6f7a-2650-4c34-9b54-87088afc6c29 on hv-cinder-81322 Dec 15 13:44:46.117293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-0cdef79f-fa3a-47c1-8b6f-93a4af84fd85 req-601bba27-a9cb-4224-b142-424dec4ad58e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030983 Dec 15 13:44:46.120719 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 534/1064] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:46.144645 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f56e3576-fcbe-498b-9c67-ece36bab0e7f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:46.147457 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f56e3576-fcbe-498b-9c67-ece36bab0e7f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:46.155577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f56e3576-fcbe-498b-9c67-ece36bab0e7f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:46.156310 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f56e3576-fcbe-498b-9c67-ece36bab0e7f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:46.157127 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f56e3576-fcbe-498b-9c67-ece36bab0e7f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:46.157603 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f56e3576-fcbe-498b-9c67-ece36bab0e7f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:46.230237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f56e3576-fcbe-498b-9c67-ece36bab0e7f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:46.238648 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f56e3576-fcbe-498b-9c67-ece36bab0e7f tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 200 len: 1302 microversion: 2.1 time: 0.101071 Dec 15 13:44:46.239236 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 531/1065] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:46 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:47.014848 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-98f84a9f-e9f9-4a71-8895-749d7a30a2f6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:47.015831 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-98f84a9f-e9f9-4a71-8895-749d7a30a2f6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:47.022862 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-98f84a9f-e9f9-4a71-8895-749d7a30a2f6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:47.023513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-98f84a9f-e9f9-4a71-8895-749d7a30a2f6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:47.024605 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-98f84a9f-e9f9-4a71-8895-749d7a30a2f6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:47.025222 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-98f84a9f-e9f9-4a71-8895-749d7a30a2f6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:47.102370 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-98f84a9f-e9f9-4a71-8895-749d7a30a2f6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 33406 microversion: 2.1 time: 0.091385 Dec 15 13:44:47.103059 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 535/1066] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:47 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 33406 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:47.255510 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:47.256111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 81fc6f7a-2650-4c34-9b54-87088afc6c29] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:47.262391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:47.262832 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:47.263596 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:47.264024 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:47.278183 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] HTTP exception thrown: Instance 81fc6f7a-2650-4c34-9b54-87088afc6c29 could not be found. Dec 15 13:44:47.278689 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Returning 404 to user: Instance 81fc6f7a-2650-4c34-9b54-87088afc6c29 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:44:47.279485 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-5675eb80-a6e8-4a5a-b337-b75a0106ffb0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29" status: 404 len: 111 microversion: 2.1 time: 0.027711 Dec 15 13:44:47.280001 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 532/1067] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:47 2021] GET /compute/v2.1/servers/81fc6f7a-2650-4c34-9b54-87088afc6c29 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:44:47.288865 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-ec831bfa-23af-4298-aa69-f46a1083b75e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:47.289438 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ec831bfa-23af-4298-aa69-f46a1083b75e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:47.296286 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ec831bfa-23af-4298-aa69-f46a1083b75e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:47.296744 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ec831bfa-23af-4298-aa69-f46a1083b75e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:47.297520 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ec831bfa-23af-4298-aa69-f46a1083b75e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:47.297989 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-ec831bfa-23af-4298-aa69-f46a1083b75e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:47.322890 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-ec831bfa-23af-4298-aa69-f46a1083b75e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:44:47.400803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-ec831bfa-23af-4298-aa69-f46a1083b75e tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 204 len: 0 microversion: 2.1 time: 0.116077 Dec 15 13:44:47.401461 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 536/1068] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:44:47 2021] DELETE /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:44:47.410057 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f04c21fc-6319-45f6-b73a-df391726c7ce tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:47.410658 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f04c21fc-6319-45f6-b73a-df391726c7ce tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:47.416955 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f04c21fc-6319-45f6-b73a-df391726c7ce tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:47.417397 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f04c21fc-6319-45f6-b73a-df391726c7ce tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:47.418193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f04c21fc-6319-45f6-b73a-df391726c7ce tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:47.418622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f04c21fc-6319-45f6-b73a-df391726c7ce tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:47.551470 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f04c21fc-6319-45f6-b73a-df391726c7ce tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:47.559666 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f04c21fc-6319-45f6-b73a-df391726c7ce tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1514 microversion: 2.1 time: 0.153687 Dec 15 13:44:47.560257 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 533/1069] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:47 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:44:48.114636 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2a0ddff3-471e-4f99-9059-65812381ce14 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:48.115680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2a0ddff3-471e-4f99-9059-65812381ce14 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:48.122737 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2a0ddff3-471e-4f99-9059-65812381ce14 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:48.123185 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2a0ddff3-471e-4f99-9059-65812381ce14 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:48.123972 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2a0ddff3-471e-4f99-9059-65812381ce14 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:48.124399 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2a0ddff3-471e-4f99-9059-65812381ce14 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:48.202040 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2a0ddff3-471e-4f99-9059-65812381ce14 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 34455 microversion: 2.1 time: 0.091264 Dec 15 13:44:48.202678 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 537/1070] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:48 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 34455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:48.577629 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b045907e-2edc-4dd5-9b34-f0662a7bb393 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:48.578255 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b045907e-2edc-4dd5-9b34-f0662a7bb393 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:48.585391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b045907e-2edc-4dd5-9b34-f0662a7bb393 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:48.585859 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b045907e-2edc-4dd5-9b34-f0662a7bb393 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:48.586633 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b045907e-2edc-4dd5-9b34-f0662a7bb393 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:48.587084 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b045907e-2edc-4dd5-9b34-f0662a7bb393 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:48.719743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-b045907e-2edc-4dd5-9b34-f0662a7bb393 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:48.727819 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b045907e-2edc-4dd5-9b34-f0662a7bb393 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1514 microversion: 2.1 time: 0.153990 Dec 15 13:44:48.728449 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 534/1071] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:48 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:49.214336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d5933d3e-ce22-47d4-99dd-1e8617c6175c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:49.215411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d5933d3e-ce22-47d4-99dd-1e8617c6175c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:49.222464 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d5933d3e-ce22-47d4-99dd-1e8617c6175c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:49.222979 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d5933d3e-ce22-47d4-99dd-1e8617c6175c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:49.223819 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d5933d3e-ce22-47d4-99dd-1e8617c6175c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:49.224320 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d5933d3e-ce22-47d4-99dd-1e8617c6175c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:49.299295 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d5933d3e-ce22-47d4-99dd-1e8617c6175c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 35531 microversion: 2.1 time: 0.088739 Dec 15 13:44:49.301032 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 538/1072] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:49 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 35531 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:49.428321 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-d17c15ce-0c9b-4f08-8c7b-021848b9a970 req-b2e1aae6-26f7-4380-a921-7b817ed86835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69324657-790e-43bb-b7e1-329f460b482e", "name": "network-vif-deleted", "tag": "52bdc64f-eed7-4cad-83de-af3e9be9b44a"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:49.429909 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:49.429909 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:44:49.437640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-d17c15ce-0c9b-4f08-8c7b-021848b9a970 req-b2e1aae6-26f7-4380-a921-7b817ed86835 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:49.438521 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-d17c15ce-0c9b-4f08-8c7b-021848b9a970 req-b2e1aae6-26f7-4380-a921-7b817ed86835 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:49.449392 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-d17c15ce-0c9b-4f08-8c7b-021848b9a970 req-b2e1aae6-26f7-4380-a921-7b817ed86835 service nova] Creating event network-vif-deleted:52bdc64f-eed7-4cad-83de-af3e9be9b44a for instance 69324657-790e-43bb-b7e1-329f460b482e on hv-cinder-81322 Dec 15 13:44:49.454653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-d17c15ce-0c9b-4f08-8c7b-021848b9a970 req-b2e1aae6-26f7-4380-a921-7b817ed86835 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030509 Dec 15 13:44:49.457924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 535/1073] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:49.745115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:49.745832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:49.752570 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:49.753004 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:49.754646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:49.754646 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:49.786167 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:49.786609 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:49.787045 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lazy-loading 'fault' on Instance uuid 69324657-790e-43bb-b7e1-329f460b482e {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:44:49.826276 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:49.834660 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-34b40897-4f77-42c9-8620-d4fccdc02d66 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 200 len: 1308 microversion: 2.1 time: 0.093724 Dec 15 13:44:49.835234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 539/1074] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:49 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:50.312534 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-26b2a2bb-9276-4493-9ece-b814c2de93e8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:50.313598 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-26b2a2bb-9276-4493-9ece-b814c2de93e8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:50.320482 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26b2a2bb-9276-4493-9ece-b814c2de93e8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:50.320909 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26b2a2bb-9276-4493-9ece-b814c2de93e8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:50.321679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26b2a2bb-9276-4493-9ece-b814c2de93e8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:50.322132 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26b2a2bb-9276-4493-9ece-b814c2de93e8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:50.406149 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-26b2a2bb-9276-4493-9ece-b814c2de93e8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 36846 microversion: 2.1 time: 0.097447 Dec 15 13:44:50.406797 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 536/1075] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:50 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 36846 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:50.852623 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:50.853300 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 69324657-790e-43bb-b7e1-329f460b482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:50.859834 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:50.860274 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:50.861207 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:50.861644 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:50.875372 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] HTTP exception thrown: Instance 69324657-790e-43bb-b7e1-329f460b482e could not be found. Dec 15 13:44:50.875955 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Returning 404 to user: Instance 69324657-790e-43bb-b7e1-329f460b482e could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:44:50.876797 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e955cddd-efcd-4c9b-8803-57e8007bcec0 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e" status: 404 len: 111 microversion: 2.1 time: 0.028193 Dec 15 13:44:50.877336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 540/1076] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:50 2021] GET /compute/v2.1/servers/69324657-790e-43bb-b7e1-329f460b482e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:44:51.421170 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a8d97cfa-b80b-4451-a0c1-a38e9b8b8625 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:51.422647 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a8d97cfa-b80b-4451-a0c1-a38e9b8b8625 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:51.430953 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a8d97cfa-b80b-4451-a0c1-a38e9b8b8625 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:51.431398 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a8d97cfa-b80b-4451-a0c1-a38e9b8b8625 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:51.432189 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a8d97cfa-b80b-4451-a0c1-a38e9b8b8625 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:51.432619 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a8d97cfa-b80b-4451-a0c1-a38e9b8b8625 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:51.508984 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a8d97cfa-b80b-4451-a0c1-a38e9b8b8625 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 38082 microversion: 2.1 time: 0.092963 Dec 15 13:44:51.509516 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 537/1077] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:51 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 38082 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:52.010020 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f30a3bf5-4254-4497-9bd5-db836815bdf4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:52.010566 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f30a3bf5-4254-4497-9bd5-db836815bdf4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:52.016915 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f30a3bf5-4254-4497-9bd5-db836815bdf4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:52.017373 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f30a3bf5-4254-4497-9bd5-db836815bdf4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:52.018206 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f30a3bf5-4254-4497-9bd5-db836815bdf4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:52.018630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f30a3bf5-4254-4497-9bd5-db836815bdf4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:52.044261 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f30a3bf5-4254-4497-9bd5-db836815bdf4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:44:52.120455 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f30a3bf5-4254-4497-9bd5-db836815bdf4 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 204 len: 0 microversion: 2.1 time: 0.113842 Dec 15 13:44:52.121079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 541/1078] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:44:52 2021] DELETE /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 13:44:52.131209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-24a07112-f880-42b5-9ff2-c44e251a7092 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:52.131908 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-24a07112-f880-42b5-9ff2-c44e251a7092 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:52.138926 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-24a07112-f880-42b5-9ff2-c44e251a7092 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:52.139373 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-24a07112-f880-42b5-9ff2-c44e251a7092 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:52.140191 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-24a07112-f880-42b5-9ff2-c44e251a7092 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:52.140628 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-24a07112-f880-42b5-9ff2-c44e251a7092 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:52.282070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-24a07112-f880-42b5-9ff2-c44e251a7092 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:52.290665 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-24a07112-f880-42b5-9ff2-c44e251a7092 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1512 microversion: 2.1 time: 0.163834 Dec 15 13:44:52.291233 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 538/1079] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:52 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:52.522401 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-fc0cd1d9-7623-4bb0-8eb6-a12981a7153c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:52.523336 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-fc0cd1d9-7623-4bb0-8eb6-a12981a7153c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:52.530443 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fc0cd1d9-7623-4bb0-8eb6-a12981a7153c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:52.530978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fc0cd1d9-7623-4bb0-8eb6-a12981a7153c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:52.531984 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fc0cd1d9-7623-4bb0-8eb6-a12981a7153c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:52.532528 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-fc0cd1d9-7623-4bb0-8eb6-a12981a7153c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:52.611554 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-fc0cd1d9-7623-4bb0-8eb6-a12981a7153c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 38163 microversion: 2.1 time: 0.093605 Dec 15 13:44:52.612313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 542/1080] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:52 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 38163 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:53.309029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-16ed3ece-04db-407e-9f17-10eab5706937 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:53.309575 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-16ed3ece-04db-407e-9f17-10eab5706937 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:53.316344 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-16ed3ece-04db-407e-9f17-10eab5706937 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:53.316826 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-16ed3ece-04db-407e-9f17-10eab5706937 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:53.317679 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-16ed3ece-04db-407e-9f17-10eab5706937 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:53.318245 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-16ed3ece-04db-407e-9f17-10eab5706937 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:53.455391 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-16ed3ece-04db-407e-9f17-10eab5706937 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:53.464030 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-16ed3ece-04db-407e-9f17-10eab5706937 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1512 microversion: 2.1 time: 0.158707 Dec 15 13:44:53.464623 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 539/1081] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:53 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:53.624154 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a22ace16-44b3-4fab-b2fb-b097c46d1c71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:53.625148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-a22ace16-44b3-4fab-b2fb-b097c46d1c71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:53.633146 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a22ace16-44b3-4fab-b2fb-b097c46d1c71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:53.633600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a22ace16-44b3-4fab-b2fb-b097c46d1c71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:53.634415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a22ace16-44b3-4fab-b2fb-b097c46d1c71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:53.634847 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-a22ace16-44b3-4fab-b2fb-b097c46d1c71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:53.745820 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a22ace16-44b3-4fab-b2fb-b097c46d1c71 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 38163 microversion: 2.1 time: 0.125448 Dec 15 13:44:53.746459 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 543/1082] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:53 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 38163 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:54.481501 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-16d16848-5ae2-4053-8607-058287548702 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:54.482351 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-16d16848-5ae2-4053-8607-058287548702 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:54.488758 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-16d16848-5ae2-4053-8607-058287548702 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:54.489212 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-16d16848-5ae2-4053-8607-058287548702 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:54.490029 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-16d16848-5ae2-4053-8607-058287548702 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:54.490747 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-16d16848-5ae2-4053-8607-058287548702 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:54.555833 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-16d16848-5ae2-4053-8607-058287548702 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f1e439f9aa45cdbdc0155405423942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d663b994c834c358d7a268a08eac730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:44:54.563686 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-16d16848-5ae2-4053-8607-058287548702 tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 200 len: 1470 microversion: 2.1 time: 0.085875 Dec 15 13:44:54.567486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 540/1083] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:54 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 1470 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:44:54.578195 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-2b649b7f-a04d-4070-a4b1-b010b65b65e0 req-59fb4fcb-357f-4971-a2b2-00821eef2c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1352a3-d493-4909-8040-b4fbcb58aa09", "name": "network-vif-deleted", "tag": "a936e9ef-9421-41df-a2c8-8d0361adf90f"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:54.579709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:44:54.579709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:44:54.588776 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-2b649b7f-a04d-4070-a4b1-b010b65b65e0 req-59fb4fcb-357f-4971-a2b2-00821eef2c13 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:54.589219 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-2b649b7f-a04d-4070-a4b1-b010b65b65e0 req-59fb4fcb-357f-4971-a2b2-00821eef2c13 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:54.603746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-2b649b7f-a04d-4070-a4b1-b010b65b65e0 req-59fb4fcb-357f-4971-a2b2-00821eef2c13 service nova] Creating event network-vif-deleted:a936e9ef-9421-41df-a2c8-8d0361adf90f for instance 4e1352a3-d493-4909-8040-b4fbcb58aa09 on hv-cinder-81322 Dec 15 13:44:54.608866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-2b649b7f-a04d-4070-a4b1-b010b65b65e0 req-59fb4fcb-357f-4971-a2b2-00821eef2c13 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034771 Dec 15 13:44:54.609440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 544/1084] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:44:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:44:54.758226 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2e876b4d-6d33-44d8-8861-b9b371703e76 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:54.759147 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2e876b4d-6d33-44d8-8861-b9b371703e76 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:54.766478 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2e876b4d-6d33-44d8-8861-b9b371703e76 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:54.766933 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2e876b4d-6d33-44d8-8861-b9b371703e76 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:54.767923 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2e876b4d-6d33-44d8-8861-b9b371703e76 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:54.768384 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2e876b4d-6d33-44d8-8861-b9b371703e76 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:54.837838 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2e876b4d-6d33-44d8-8861-b9b371703e76 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 38163 microversion: 2.1 time: 0.083063 Dec 15 13:44:54.838653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 541/1085] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:54 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 38163 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:55.584134 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:55.584832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] [instance: 4e1352a3-d493-4909-8040-b4fbcb58aa09] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:55.590886 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:55.591334 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:55.592110 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:55.592550 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:55.606474 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] HTTP exception thrown: Instance 4e1352a3-d493-4909-8040-b4fbcb58aa09 could not be found. Dec 15 13:44:55.607049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] Returning 404 to user: Instance 4e1352a3-d493-4909-8040-b4fbcb58aa09 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:44:55.607856 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-51ca69da-c379-467b-8080-86fe4ed08afb tempest-AttachVolumeNegativeTest-1611569182 tempest-AttachVolumeNegativeTest-1611569182-project] 10.222.0.83 "GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09" status: 404 len: 111 microversion: 2.1 time: 0.028397 Dec 15 13:44:55.608398 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 545/1086] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:44:55 2021] GET /compute/v2.1/servers/4e1352a3-d493-4909-8040-b4fbcb58aa09 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:44:55.850891 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0ffe311c-285d-4f91-8ffc-3d129b884af8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:55.851813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0ffe311c-285d-4f91-8ffc-3d129b884af8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:55.858774 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0ffe311c-285d-4f91-8ffc-3d129b884af8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:55.859209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0ffe311c-285d-4f91-8ffc-3d129b884af8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:55.859990 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0ffe311c-285d-4f91-8ffc-3d129b884af8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:55.860423 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0ffe311c-285d-4f91-8ffc-3d129b884af8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:55.936099 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0ffe311c-285d-4f91-8ffc-3d129b884af8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action" status: 200 len: 38293 microversion: 2.1 time: 0.090532 Dec 15 13:44:55.937717 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 542/1087] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Dec 15 13:44:55 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/action => generated 38293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 13:44:55.947501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-83403ee7-c3c2-4f02-ba06-eaadd870c5a6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:44:55.947986 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-83403ee7-c3c2-4f02-ba06-eaadd870c5a6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:55.955278 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-83403ee7-c3c2-4f02-ba06-eaadd870c5a6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:55.955744 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-83403ee7-c3c2-4f02-ba06-eaadd870c5a6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:55.957078 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-83403ee7-c3c2-4f02-ba06-eaadd870c5a6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:55.957520 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-83403ee7-c3c2-4f02-ba06-eaadd870c5a6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:55.983632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-83403ee7-c3c2-4f02-ba06-eaadd870c5a6 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/ips" status: 200 len: 146 microversion: 2.1 time: 0.039858 Dec 15 13:44:55.984201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 546/1088] 10.222.0.83 () {58 vars in 1247 bytes} [Wed Dec 15 13:44:55 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:44:57.319178 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ce48b282-fd78-4c32-9395-8da0fee1492e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aca0baef-cd0e-4756-b181-c1b864146e61"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:44:57.320324 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ce48b282-fd78-4c32-9395-8da0fee1492e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:44:57.327143 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ce48b282-fd78-4c32-9395-8da0fee1492e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:57.327591 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ce48b282-fd78-4c32-9395-8da0fee1492e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:57.328374 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ce48b282-fd78-4c32-9395-8da0fee1492e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:44:57.328802 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ce48b282-fd78-4c32-9395-8da0fee1492e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:44:57.587947 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ce48b282-fd78-4c32-9395-8da0fee1492e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272756 Dec 15 13:44:57.588555 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 543/1089] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:44:57 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:04.022606 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-0c7cecb7-71ab-4bae-b472-18d7762212b5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:04.023506 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-0c7cecb7-71ab-4bae-b472-18d7762212b5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:04.029745 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c7cecb7-71ab-4bae-b472-18d7762212b5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:04.030242 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c7cecb7-71ab-4bae-b472-18d7762212b5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:04.031008 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c7cecb7-71ab-4bae-b472-18d7762212b5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:04.031437 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-0c7cecb7-71ab-4bae-b472-18d7762212b5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:04.061700 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-0c7cecb7-71ab-4bae-b472-18d7762212b5 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042828 Dec 15 13:45:04.062282 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 547/1090] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:45:04 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:04.074226 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-eaa1b853-f332-406a-9207-7c540b0fd84c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:04.074841 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-eaa1b853-f332-406a-9207-7c540b0fd84c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:04.081098 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eaa1b853-f332-406a-9207-7c540b0fd84c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:04.081548 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eaa1b853-f332-406a-9207-7c540b0fd84c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:04.082368 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eaa1b853-f332-406a-9207-7c540b0fd84c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:04.082923 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-eaa1b853-f332-406a-9207-7c540b0fd84c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:04.111429 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-eaa1b853-f332-406a-9207-7c540b0fd84c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/aca0baef-cd0e-4756-b181-c1b864146e61" status: 200 len: 194 microversion: 2.1 time: 0.041909 Dec 15 13:45:04.112041 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 544/1091] 10.222.0.83 () {58 vars in 1412 bytes} [Wed Dec 15 13:45:04 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/aca0baef-cd0e-4756-b181-c1b864146e61 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:05.410516 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-6b8c59a1-3007-4783-9327-f243804ef8af tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "221cc003-71f0-4a5d-accb-337a80ebb1b9"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:45:05.411548 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-6b8c59a1-3007-4783-9327-f243804ef8af tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:05.418500 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b8c59a1-3007-4783-9327-f243804ef8af tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:05.419164 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b8c59a1-3007-4783-9327-f243804ef8af tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:05.420148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b8c59a1-3007-4783-9327-f243804ef8af tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:05.420638 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-6b8c59a1-3007-4783-9327-f243804ef8af tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:05.678044 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-6b8c59a1-3007-4783-9327-f243804ef8af tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271444 Dec 15 13:45:05.678662 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 548/1092] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:45:05 2021] POST /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:13.137629 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-41440842-bda7-4851-bc67-030e851a3fc8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:13.138624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-41440842-bda7-4851-bc67-030e851a3fc8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:13.145439 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-41440842-bda7-4851-bc67-030e851a3fc8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:13.145930 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-41440842-bda7-4851-bc67-030e851a3fc8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:13.146714 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-41440842-bda7-4851-bc67-030e851a3fc8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:13.147153 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-41440842-bda7-4851-bc67-030e851a3fc8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:13.179026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-41440842-bda7-4851-bc67-030e851a3fc8 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045191 Dec 15 13:45:13.179580 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 545/1093] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:45:13 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:13.479583 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e74b2cb2-138d-49a0-b9b0-cba630d2230d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:13.480161 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e74b2cb2-138d-49a0-b9b0-cba630d2230d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:13.486317 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e74b2cb2-138d-49a0-b9b0-cba630d2230d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:13.486757 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e74b2cb2-138d-49a0-b9b0-cba630d2230d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:13.487533 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e74b2cb2-138d-49a0-b9b0-cba630d2230d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:13.487966 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e74b2cb2-138d-49a0-b9b0-cba630d2230d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:13.515620 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e74b2cb2-138d-49a0-b9b0-cba630d2230d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/aca0baef-cd0e-4756-b181-c1b864146e61" status: 200 len: 194 microversion: 2.1 time: 0.040728 Dec 15 13:45:13.516177 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 549/1094] 10.222.0.83 () {58 vars in 1412 bytes} [Wed Dec 15 13:45:13 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/aca0baef-cd0e-4756-b181-c1b864146e61 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:13.526342 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-211e0d80-bd25-4d7b-9189-a60f4d53550c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:13.526840 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-211e0d80-bd25-4d7b-9189-a60f4d53550c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:13.533161 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-211e0d80-bd25-4d7b-9189-a60f4d53550c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:13.533612 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-211e0d80-bd25-4d7b-9189-a60f4d53550c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:13.534437 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-211e0d80-bd25-4d7b-9189-a60f4d53550c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:13.534873 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-211e0d80-bd25-4d7b-9189-a60f4d53550c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:13.614461 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-211e0d80-bd25-4d7b-9189-a60f4d53550c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lazy-loading 'services' on Instance uuid cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:45:13.682020 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-211e0d80-bd25-4d7b-9189-a60f4d53550c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/aca0baef-cd0e-4756-b181-c1b864146e61" status: 202 len: 0 microversion: 2.1 time: 0.159255 Dec 15 13:45:13.682677 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 546/1095] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:45:13 2021] DELETE /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/aca0baef-cd0e-4756-b181-c1b864146e61 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:45:14.790981 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-827b8867-7b36-497a-acab-cbdaafe06424 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:14.791513 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-827b8867-7b36-497a-acab-cbdaafe06424 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:14.797568 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-827b8867-7b36-497a-acab-cbdaafe06424 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:14.798035 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-827b8867-7b36-497a-acab-cbdaafe06424 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:14.798833 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-827b8867-7b36-497a-acab-cbdaafe06424 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:14.799266 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-827b8867-7b36-497a-acab-cbdaafe06424 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:14.831640 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-827b8867-7b36-497a-acab-cbdaafe06424 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/221cc003-71f0-4a5d-accb-337a80ebb1b9" status: 200 len: 194 microversion: 2.1 time: 0.044375 Dec 15 13:45:14.832729 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 550/1096] 10.222.0.83 () {58 vars in 1412 bytes} [Wed Dec 15 13:45:14 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/221cc003-71f0-4a5d-accb-337a80ebb1b9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:14.843235 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b4468df3-bc71-4dbd-883f-93eed39f206c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:14.843858 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b4468df3-bc71-4dbd-883f-93eed39f206c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:14.850713 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b4468df3-bc71-4dbd-883f-93eed39f206c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:14.851151 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b4468df3-bc71-4dbd-883f-93eed39f206c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:14.852075 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b4468df3-bc71-4dbd-883f-93eed39f206c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:14.852353 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b4468df3-bc71-4dbd-883f-93eed39f206c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:14.936052 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-b4468df3-bc71-4dbd-883f-93eed39f206c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lazy-loading 'services' on Instance uuid cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:45:15.012941 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b4468df3-bc71-4dbd-883f-93eed39f206c tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/221cc003-71f0-4a5d-accb-337a80ebb1b9" status: 202 len: 0 microversion: 2.1 time: 0.173966 Dec 15 13:45:15.013557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 547/1097] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:45:14 2021] DELETE /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments/221cc003-71f0-4a5d-accb-337a80ebb1b9 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:45:16.177252 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-2561f0ff-cd51-480b-94b5-e14c3de4eb1d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:16.178231 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-2561f0ff-cd51-480b-94b5-e14c3de4eb1d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:16.184371 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2561f0ff-cd51-480b-94b5-e14c3de4eb1d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:16.184816 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2561f0ff-cd51-480b-94b5-e14c3de4eb1d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:16.185587 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2561f0ff-cd51-480b-94b5-e14c3de4eb1d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:16.186046 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-2561f0ff-cd51-480b-94b5-e14c3de4eb1d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:16.214979 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-2561f0ff-cd51-480b-94b5-e14c3de4eb1d tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041404 Dec 15 13:45:16.215527 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 551/1098] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:45:16 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:45:16.317187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-b6d73442-f1ac-42ee-9bf9-c52b4af3394f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:16.318177 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-b6d73442-f1ac-42ee-9bf9-c52b4af3394f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:16.324118 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b6d73442-f1ac-42ee-9bf9-c52b4af3394f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:16.324562 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b6d73442-f1ac-42ee-9bf9-c52b4af3394f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:16.325322 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b6d73442-f1ac-42ee-9bf9-c52b4af3394f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:16.325777 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-b6d73442-f1ac-42ee-9bf9-c52b4af3394f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:16.355951 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-b6d73442-f1ac-42ee-9bf9-c52b4af3394f tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043120 Dec 15 13:45:16.356502 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 548/1099] 10.222.0.83 () {58 vars in 1301 bytes} [Wed Dec 15 13:45:16 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 13:45:16.412526 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-19fc6538-1dfe-45d2-8a15-124b7672d4fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:16.413049 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-19fc6538-1dfe-45d2-8a15-124b7672d4fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:16.418858 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19fc6538-1dfe-45d2-8a15-124b7672d4fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:16.419304 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19fc6538-1dfe-45d2-8a15-124b7672d4fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:16.420077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19fc6538-1dfe-45d2-8a15-124b7672d4fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:16.420511 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19fc6538-1dfe-45d2-8a15-124b7672d4fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:16.444331 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-19fc6538-1dfe-45d2-8a15-124b7672d4fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:45:16.520223 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-19fc6538-1dfe-45d2-8a15-124b7672d4fc tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 204 len: 0 microversion: 2.1 time: 0.110339 Dec 15 13:45:16.521192 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 552/1100] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:45:16 2021] DELETE /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:45:16.529550 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c33c6c56-7a7b-48a1-8ec3-5f20ad40145a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:16.530186 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c33c6c56-7a7b-48a1-8ec3-5f20ad40145a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:16.536038 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c33c6c56-7a7b-48a1-8ec3-5f20ad40145a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:16.536481 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c33c6c56-7a7b-48a1-8ec3-5f20ad40145a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:16.537248 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c33c6c56-7a7b-48a1-8ec3-5f20ad40145a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:16.537678 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c33c6c56-7a7b-48a1-8ec3-5f20ad40145a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:16.670938 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c33c6c56-7a7b-48a1-8ec3-5f20ad40145a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:16.678441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c33c6c56-7a7b-48a1-8ec3-5f20ad40145a tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1675 microversion: 2.1 time: 0.152578 Dec 15 13:45:16.679094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 549/1101] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:16 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:45:17.697113 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e8574281-ff7b-4d28-89d9-3b7f8cbb05d2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:17.697825 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e8574281-ff7b-4d28-89d9-3b7f8cbb05d2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:17.704225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e8574281-ff7b-4d28-89d9-3b7f8cbb05d2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:17.704667 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e8574281-ff7b-4d28-89d9-3b7f8cbb05d2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:17.705540 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e8574281-ff7b-4d28-89d9-3b7f8cbb05d2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:17.706001 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e8574281-ff7b-4d28-89d9-3b7f8cbb05d2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:17.841375 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e8574281-ff7b-4d28-89d9-3b7f8cbb05d2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:17.849604 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e8574281-ff7b-4d28-89d9-3b7f8cbb05d2 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1675 microversion: 2.1 time: 0.156605 Dec 15 13:45:17.850199 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 553/1102] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:17 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:18.867488 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-2421a491-3a24-4828-96dd-4e6b64c39d7e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:18.868096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-2421a491-3a24-4828-96dd-4e6b64c39d7e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:18.874471 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2421a491-3a24-4828-96dd-4e6b64c39d7e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:18.874919 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2421a491-3a24-4828-96dd-4e6b64c39d7e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:18.875702 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2421a491-3a24-4828-96dd-4e6b64c39d7e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:18.876137 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-2421a491-3a24-4828-96dd-4e6b64c39d7e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:18.943869 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-2421a491-3a24-4828-96dd-4e6b64c39d7e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c98a5d1c09e43c99bcbc1e9785d1edd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10799d1b1db34e69a6c6bba276744b0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:18.951539 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-2421a491-3a24-4828-96dd-4e6b64c39d7e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 200 len: 1607 microversion: 2.1 time: 0.088177 Dec 15 13:45:18.952143 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 550/1103] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:18 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 1607 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:19.236077 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-6150c7ce-1746-4f76-8d50-76774ce7b1d6 req-f8555c88-2936-4077-8488-25474be9ab7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd0d7fb7-7dbd-4a9f-9366-a551a0899d91", "name": "network-vif-deleted", "tag": "7cd7dbfc-bd2e-4f55-898d-aa1bc487bb07"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:45:19.238545 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:45:19.238545 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:45:19.246312 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-6150c7ce-1746-4f76-8d50-76774ce7b1d6 req-f8555c88-2936-4077-8488-25474be9ab7e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:19.246746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-6150c7ce-1746-4f76-8d50-76774ce7b1d6 req-f8555c88-2936-4077-8488-25474be9ab7e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:19.259188 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-6150c7ce-1746-4f76-8d50-76774ce7b1d6 req-f8555c88-2936-4077-8488-25474be9ab7e service nova] Creating event network-vif-deleted:7cd7dbfc-bd2e-4f55-898d-aa1bc487bb07 for instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 on hv-cinder-81322 Dec 15 13:45:19.264121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-6150c7ce-1746-4f76-8d50-76774ce7b1d6 req-f8555c88-2936-4077-8488-25474be9ab7e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035629 Dec 15 13:45:19.264743 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 554/1104] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:19.968414 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:19.969024 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:19.975836 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:19.976288 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:19.977070 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:19.977510 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:19.991602 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] HTTP exception thrown: Instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 could not be found. Dec 15 13:45:19.992194 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Returning 404 to user: Instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:19.993008 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cf942b0f-76b3-4940-adfc-f9f2a5dfb1e9 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 404 len: 111 microversion: 2.1 time: 0.028432 Dec 15 13:45:19.993557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 551/1105] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:19 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:20.005147 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-a7561bb9-b222-40f1-8e84-2903a80a3d11 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '.version_select at 0x7fd78ff1ad30>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:20.032732 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-a7561bb9-b222-40f1-8e84-2903a80a3d11 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182403448" status: 202 len: 0 microversion: 2.1 time: 0.031926 Dec 15 13:45:20.033300 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 555/1106] 10.222.0.83 () {58 vars in 1220 bytes} [Wed Dec 15 13:45:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182403448 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:45:22.957358 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:22.957909 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:22.964581 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:22.965039 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:22.965847 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:22.966290 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:22.979741 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] HTTP exception thrown: Instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 could not be found. Dec 15 13:45:22.980364 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Returning 404 to user: Instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:22.981192 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-68d5a962-549b-46ec-a1fa-3022b6245282 tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 404 len: 111 microversion: 2.1 time: 0.027608 Dec 15 13:45:22.981723 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 552/1107] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:45:22 2021] DELETE /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:22.989921 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:22.990619 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: cd0d7fb7-7dbd-4a9f-9366-a551a0899d91] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:22.996946 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:22.997389 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:22.998194 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:22.998621 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:23.011792 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] HTTP exception thrown: Instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 could not be found. Dec 15 13:45:23.012365 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Returning 404 to user: Instance cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:23.013190 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-19c923af-0a4f-490d-8a0f-3734c18a08ef tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91" status: 404 len: 111 microversion: 2.1 time: 0.027504 Dec 15 13:45:23.013705 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 556/1108] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:22 2021] GET /compute/v2.1/servers/cd0d7fb7-7dbd-4a9f-9366-a551a0899d91 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:24.137157 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:24.137653 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:24.144009 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:24.144452 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:24.145881 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:24.146314 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:24.159259 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] HTTP exception thrown: Instance 09248873-3a26-46a0-bbd1-b3574f74bc7a could not be found. Dec 15 13:45:24.159833 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Returning 404 to user: Instance 09248873-3a26-46a0-bbd1-b3574f74bc7a could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:24.160637 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d23f6b16-5460-4643-a549-9a812a8712eb tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "DELETE /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 404 len: 111 microversion: 2.1 time: 0.027161 Dec 15 13:45:24.161187 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 553/1109] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:45:24 2021] DELETE /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:24.168618 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:24.169225 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] [instance: 09248873-3a26-46a0-bbd1-b3574f74bc7a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:24.175323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:24.175771 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:24.176617 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:24.177048 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:24.189988 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] HTTP exception thrown: Instance 09248873-3a26-46a0-bbd1-b3574f74bc7a could not be found. Dec 15 13:45:24.190585 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] Returning 404 to user: Instance 09248873-3a26-46a0-bbd1-b3574f74bc7a could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:24.191432 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d0a9852c-bc33-449e-a579-ea41261bf27e tempest-AttachVolumeTestJSON-301973046 tempest-AttachVolumeTestJSON-301973046-project] 10.222.0.83 "GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a" status: 404 len: 111 microversion: 2.1 time: 0.026419 Dec 15 13:45:24.192681 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 557/1110] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:24 2021] GET /compute/v2.1/servers/09248873-3a26-46a0-bbd1-b3574f74bc7a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:46.426809 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-d8c6da88-73ee-4474-9de7-98e12850fabb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:46.428600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-4dee258b-9c31-47ce-baa9-7b99e109bea3 req-cb319d71-5509-4f90-a926-5644a44db84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9aceb1-a94c-418d-bbb3-bcc4b14f482e", "tag": "ad5d037e-580b-4432-81b5-1d7c3583d89d"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:45:46.430776 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:45:46.430776 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:45:46.433209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d8c6da88-73ee-4474-9de7-98e12850fabb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:46.445026 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-4dee258b-9c31-47ce-baa9-7b99e109bea3 req-cb319d71-5509-4f90-a926-5644a44db84b service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:46.445468 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-4dee258b-9c31-47ce-baa9-7b99e109bea3 req-cb319d71-5509-4f90-a926-5644a44db84b service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:46.449822 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8c6da88-73ee-4474-9de7-98e12850fabb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:46.450542 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8c6da88-73ee-4474-9de7-98e12850fabb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:46.451513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8c6da88-73ee-4474-9de7-98e12850fabb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:46.452147 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-d8c6da88-73ee-4474-9de7-98e12850fabb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:46.475476 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-4dee258b-9c31-47ce-baa9-7b99e109bea3 req-cb319d71-5509-4f90-a926-5644a44db84b service nova] Creating event network-changed:ad5d037e-580b-4432-81b5-1d7c3583d89d for instance 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e on hv-cinder-81322 Dec 15 13:45:46.483259 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-4dee258b-9c31-47ce-baa9-7b99e109bea3 req-cb319d71-5509-4f90-a926-5644a44db84b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061137 Dec 15 13:45:46.483844 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 558/1111] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:45:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:46.492534 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-d8c6da88-73ee-4474-9de7-98e12850fabb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:45:46.625821 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-d8c6da88-73ee-4474-9de7-98e12850fabb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 204 len: 0 microversion: 2.1 time: 0.207355 Dec 15 13:45:46.626626 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 554/1112] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:45:46 2021] DELETE /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:45:46.635951 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4ff9df60-ac5b-4338-b7b5-3da84775cea9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:46.636830 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4ff9df60-ac5b-4338-b7b5-3da84775cea9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:46.645153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4ff9df60-ac5b-4338-b7b5-3da84775cea9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:46.646172 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4ff9df60-ac5b-4338-b7b5-3da84775cea9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:46.647380 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4ff9df60-ac5b-4338-b7b5-3da84775cea9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:46.648562 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4ff9df60-ac5b-4338-b7b5-3da84775cea9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:46.854139 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4ff9df60-ac5b-4338-b7b5-3da84775cea9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:46.863277 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4ff9df60-ac5b-4338-b7b5-3da84775cea9 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1579 microversion: 2.1 time: 0.231843 Dec 15 13:45:46.864411 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 559/1113] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:46 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1579 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:47.881523 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a90aac07-6b22-43a3-84cf-0a74db0ef631 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:47.882284 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a90aac07-6b22-43a3-84cf-0a74db0ef631 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:47.888768 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a90aac07-6b22-43a3-84cf-0a74db0ef631 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:47.889215 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a90aac07-6b22-43a3-84cf-0a74db0ef631 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:47.890031 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a90aac07-6b22-43a3-84cf-0a74db0ef631 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:47.890615 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a90aac07-6b22-43a3-84cf-0a74db0ef631 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:48.036802 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a90aac07-6b22-43a3-84cf-0a74db0ef631 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:48.044752 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a90aac07-6b22-43a3-84cf-0a74db0ef631 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1460 microversion: 2.1 time: 0.167358 Dec 15 13:45:48.045320 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 555/1114] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:47 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1460 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:48.860642 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-b1c9ac6c-33a7-4bf2-8df1-3b92abf9de51 req-5ec7f416-fab2-4442-96b5-ab7d659c155a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9aceb1-a94c-418d-bbb3-bcc4b14f482e", "name": "network-vif-deleted", "tag": "ad5d037e-580b-4432-81b5-1d7c3583d89d"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:45:48.862302 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:45:48.862302 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:45:48.870250 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-b1c9ac6c-33a7-4bf2-8df1-3b92abf9de51 req-5ec7f416-fab2-4442-96b5-ab7d659c155a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:48.870692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-b1c9ac6c-33a7-4bf2-8df1-3b92abf9de51 req-5ec7f416-fab2-4442-96b5-ab7d659c155a service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:48.884069 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-b1c9ac6c-33a7-4bf2-8df1-3b92abf9de51 req-5ec7f416-fab2-4442-96b5-ab7d659c155a service nova] Creating event network-vif-deleted:ad5d037e-580b-4432-81b5-1d7c3583d89d for instance 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e on hv-cinder-81322 Dec 15 13:45:48.889264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-b1c9ac6c-33a7-4bf2-8df1-3b92abf9de51 req-5ec7f416-fab2-4442-96b5-ab7d659c155a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032295 Dec 15 13:45:48.890199 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 560/1115] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:45:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:49.060950 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-f0f0c27d-de10-4fff-9d12-39f0a158c07d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:49.061673 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-f0f0c27d-de10-4fff-9d12-39f0a158c07d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:49.068527 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f0f0c27d-de10-4fff-9d12-39f0a158c07d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:49.069256 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f0f0c27d-de10-4fff-9d12-39f0a158c07d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:49.070127 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f0f0c27d-de10-4fff-9d12-39f0a158c07d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:49.070672 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-f0f0c27d-de10-4fff-9d12-39f0a158c07d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:49.141152 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-f0f0c27d-de10-4fff-9d12-39f0a158c07d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:49.149941 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-f0f0c27d-de10-4fff-9d12-39f0a158c07d tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 200 len: 1226 microversion: 2.1 time: 0.092812 Dec 15 13:45:49.150523 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 556/1116] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:49 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:50.167632 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:50.168315 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:50.174746 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:50.175193 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:50.176041 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:50.176473 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:50.190149 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] HTTP exception thrown: Instance 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e could not be found. Dec 15 13:45:50.190734 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Returning 404 to user: Instance 4e9aceb1-a94c-418d-bbb3-bcc4b14f482e could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:50.191559 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-56ec95f8-2eb0-4ac4-96c6-31e91160a809 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e" status: 404 len: 111 microversion: 2.1 time: 0.028007 Dec 15 13:45:50.192100 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 561/1117] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:50 2021] GET /compute/v2.1/servers/4e9aceb1-a94c-418d-bbb3-bcc4b14f482e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:53.273073 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-24019468-80e3-40cf-91cd-aac9ea5928eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:53.273565 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-24019468-80e3-40cf-91cd-aac9ea5928eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:53.278385 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-b91188e1-4ced-4e5f-ba6b-01f353c09256 req-b018b39b-8a45-4bb4-aa8d-62995175d810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1f13b7-ec74-46ef-804f-57424152547a", "tag": "4e829204-dbd1-42b8-a2ff-635b2e378baf"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:45:53.280453 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-24019468-80e3-40cf-91cd-aac9ea5928eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:53.280937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-24019468-80e3-40cf-91cd-aac9ea5928eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:53.281543 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:45:53.281543 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:45:53.281911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-24019468-80e3-40cf-91cd-aac9ea5928eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:53.282271 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-24019468-80e3-40cf-91cd-aac9ea5928eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:53.290569 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-b91188e1-4ced-4e5f-ba6b-01f353c09256 req-b018b39b-8a45-4bb4-aa8d-62995175d810 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:53.291153 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-b91188e1-4ced-4e5f-ba6b-01f353c09256 req-b018b39b-8a45-4bb4-aa8d-62995175d810 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:53.304630 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-b91188e1-4ced-4e5f-ba6b-01f353c09256 req-b018b39b-8a45-4bb4-aa8d-62995175d810 service nova] Creating event network-changed:4e829204-dbd1-42b8-a2ff-635b2e378baf for instance 3e1f13b7-ec74-46ef-804f-57424152547a on hv-cinder-81322 Dec 15 13:45:53.310730 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-b91188e1-4ced-4e5f-ba6b-01f353c09256 req-b018b39b-8a45-4bb4-aa8d-62995175d810 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038201 Dec 15 13:45:53.311415 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 562/1118] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:45:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:53.323813 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-24019468-80e3-40cf-91cd-aac9ea5928eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:45:53.445939 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-24019468-80e3-40cf-91cd-aac9ea5928eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 204 len: 0 microversion: 2.1 time: 0.176785 Dec 15 13:45:53.450107 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 557/1119] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:45:53 2021] DELETE /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:45:53.455353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e5248a49-06a6-4a0d-985a-970da40321ae tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:53.456633 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e5248a49-06a6-4a0d-985a-970da40321ae tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:53.463778 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e5248a49-06a6-4a0d-985a-970da40321ae tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:53.464223 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e5248a49-06a6-4a0d-985a-970da40321ae tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:53.465004 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e5248a49-06a6-4a0d-985a-970da40321ae tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:53.465440 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e5248a49-06a6-4a0d-985a-970da40321ae tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:53.616705 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e5248a49-06a6-4a0d-985a-970da40321ae tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:53.624391 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e5248a49-06a6-4a0d-985a-970da40321ae tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1578 microversion: 2.1 time: 0.173043 Dec 15 13:45:53.625270 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 563/1120] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:53 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:45:54.645317 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-88cef2f5-5fa0-4d77-9b66-a95d90e02d02 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:54.646669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-88cef2f5-5fa0-4d77-9b66-a95d90e02d02 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:54.661459 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-88cef2f5-5fa0-4d77-9b66-a95d90e02d02 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:54.661942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-88cef2f5-5fa0-4d77-9b66-a95d90e02d02 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:54.662729 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-88cef2f5-5fa0-4d77-9b66-a95d90e02d02 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:54.663157 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-88cef2f5-5fa0-4d77-9b66-a95d90e02d02 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:54.798337 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-88cef2f5-5fa0-4d77-9b66-a95d90e02d02 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:54.806089 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-88cef2f5-5fa0-4d77-9b66-a95d90e02d02 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1460 microversion: 2.1 time: 0.165076 Dec 15 13:45:54.812767 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 558/1121] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:54 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1460 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:55.644795 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-bf55a371-fffe-4b09-bc05-714be840dc64 req-54b22691-7fbc-44bc-8256-1b26e9e85dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1f13b7-ec74-46ef-804f-57424152547a", "name": "network-vif-deleted", "tag": "4e829204-dbd1-42b8-a2ff-635b2e378baf"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:45:55.646408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:45:55.646408 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:45:55.653921 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-bf55a371-fffe-4b09-bc05-714be840dc64 req-54b22691-7fbc-44bc-8256-1b26e9e85dee service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:55.654323 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-bf55a371-fffe-4b09-bc05-714be840dc64 req-54b22691-7fbc-44bc-8256-1b26e9e85dee service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:55.667200 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-bf55a371-fffe-4b09-bc05-714be840dc64 req-54b22691-7fbc-44bc-8256-1b26e9e85dee service nova] Creating event network-vif-deleted:4e829204-dbd1-42b8-a2ff-635b2e378baf for instance 3e1f13b7-ec74-46ef-804f-57424152547a on hv-cinder-81322 Dec 15 13:45:55.672253 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-bf55a371-fffe-4b09-bc05-714be840dc64 req-54b22691-7fbc-44bc-8256-1b26e9e85dee service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Dec 15 13:45:55.672849 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 564/1122] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:45:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:45:55.822879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-cd88bc82-51e4-422a-bcc4-7e6637ab98ea tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:55.823413 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-cd88bc82-51e4-422a-bcc4-7e6637ab98ea tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:55.829937 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cd88bc82-51e4-422a-bcc4-7e6637ab98ea tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:55.830388 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cd88bc82-51e4-422a-bcc4-7e6637ab98ea tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:55.831166 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cd88bc82-51e4-422a-bcc4-7e6637ab98ea tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:55.831602 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-cd88bc82-51e4-422a-bcc4-7e6637ab98ea tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:55.893068 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-cd88bc82-51e4-422a-bcc4-7e6637ab98ea tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3a3afdfc4c44a29d0f3df50a5ed2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da9050a08e442887ca8dc346374836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:45:55.900951 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-cd88bc82-51e4-422a-bcc4-7e6637ab98ea tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 200 len: 1226 microversion: 2.1 time: 0.082203 Dec 15 13:45:55.901510 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 559/1123] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:55 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:45:56.919557 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:56.920248 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 3e1f13b7-ec74-46ef-804f-57424152547a] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:56.926457 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:56.926903 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:56.928265 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:56.928694 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:56.941572 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] HTTP exception thrown: Instance 3e1f13b7-ec74-46ef-804f-57424152547a could not be found. Dec 15 13:45:56.942184 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Returning 404 to user: Instance 3e1f13b7-ec74-46ef-804f-57424152547a could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:56.942997 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9d0bfc93-f1a3-4156-85fd-50609fd17a21 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a" status: 404 len: 111 microversion: 2.1 time: 0.028077 Dec 15 13:45:56.943521 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 565/1124] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:56 2021] GET /compute/v2.1/servers/3e1f13b7-ec74-46ef-804f-57424152547a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:57.443590 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:57.444375 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:57.450858 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:57.451299 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:57.452082 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:57.452514 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:57.467209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] HTTP exception thrown: Instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 could not be found. Dec 15 13:45:57.467810 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Returning 404 to user: Instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:57.468624 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-26689da4-b357-4c69-bfa2-e066b9df51eb tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 404 len: 111 microversion: 2.1 time: 0.029183 Dec 15 13:45:57.469159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 560/1125] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:45:57 2021] DELETE /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 13:45:57.479562 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:57.480168 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] [instance: 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:45:57.486445 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:57.486901 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:57.487691 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:45:57.488155 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:45:57.501673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] HTTP exception thrown: Instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 could not be found. Dec 15 13:45:57.502335 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Returning 404 to user: Instance 8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:45:57.503277 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e3d13a2b-f07b-4391-81c2-aa57fbfa666e tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44" status: 404 len: 111 microversion: 2.1 time: 0.027886 Dec 15 13:45:57.503817 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 566/1126] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:45:57 2021] GET /compute/v2.1/servers/8aa99337-9b29-41bc-90eb-cf4ffdbc2a44 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:45:58.817505 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-33c9a0d1-06a2-4d78-a4cc-e65b67bbef51 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] Calling method '.version_select at 0x7fd79c08e940>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:45:58.861333 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-33c9a0d1-06a2-4d78-a4cc-e65b67bbef51 tempest-TestVolumeBootPattern-1101037650 tempest-TestVolumeBootPattern-1101037650-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2022049678" status: 202 len: 0 microversion: 2.1 time: 0.047385 Dec 15 13:45:58.862259 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 561/1127] 10.222.0.83 () {58 vars in 1262 bytes} [Wed Dec 15 13:45:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2022049678 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:46:12.732293 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-139849244", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "b270e446-48ff-4f05-938d-bcf4e2d6f813"}]}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:46:12.782073 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.network.neutron [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] validate_networks() for [('b270e446-48ff-4f05-938d-bcf4e2d6f813', None, None, None, None, None)] {{(pid=122612) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:46:13.115201 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Flavor limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:46:13.115621 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Image limits 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:46:13.116089 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Flavor pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:46:13.116521 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Image pref 0:0:0 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:46:13.116922 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.virt.hardware [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:46:13.125404 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:13.125884 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:13.126692 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:13.127121 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:13.142624 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Getting quotas for project a6ee752240d24f6985d8247a0cf949d3. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:46:13.146977 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.quota [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Getting quotas for user b0ae2089722840cbb6a10b84f1ac08ed and project a6ee752240d24f6985d8247a0cf949d3. Resources: {'ram', 'cores', 'instances'} {{(pid=122612) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:46:13.158275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Going to run 1 instances... {{(pid=122612) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:46:13.160517 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:46:13.205593 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b182b977-7ce5-4fad-906f-b80c1c280640 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.476889 Dec 15 13:46:13.206269 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 567/1128] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:46:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:46:13.216487 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-fba6245a-4e96-48b0-b975-362659cf105f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:13.217096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-fba6245a-4e96-48b0-b975-362659cf105f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:13.269893 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-fba6245a-4e96-48b0-b975-362659cf105f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:13.276201 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-fba6245a-4e96-48b0-b975-362659cf105f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1218 microversion: 2.1 time: 0.063811 Dec 15 13:46:13.276756 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 562/1129] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:13 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:14.294740 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8d60ff52-3962-4c14-bb5a-39b878bc1793 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:14.295280 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8d60ff52-3962-4c14-bb5a-39b878bc1793 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:14.301348 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8d60ff52-3962-4c14-bb5a-39b878bc1793 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:14.301832 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8d60ff52-3962-4c14-bb5a-39b878bc1793 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:14.302622 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8d60ff52-3962-4c14-bb5a-39b878bc1793 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:14.303684 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8d60ff52-3962-4c14-bb5a-39b878bc1793 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:14.363966 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8d60ff52-3962-4c14-bb5a-39b878bc1793 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:14.371673 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8d60ff52-3962-4c14-bb5a-39b878bc1793 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1276 microversion: 2.1 time: 0.081318 Dec 15 13:46:14.381282 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 568/1130] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:14 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1276 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:15.388367 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-9f9dacf5-49c8-43c2-850c-59bda79088f6 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:15.389069 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-9f9dacf5-49c8-43c2-850c-59bda79088f6 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:15.395370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9f9dacf5-49c8-43c2-850c-59bda79088f6 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:15.395900 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9f9dacf5-49c8-43c2-850c-59bda79088f6 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:15.397184 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9f9dacf5-49c8-43c2-850c-59bda79088f6 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:15.397621 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-9f9dacf5-49c8-43c2-850c-59bda79088f6 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:15.531622 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-9f9dacf5-49c8-43c2-850c-59bda79088f6 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:15.540609 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-9f9dacf5-49c8-43c2-850c-59bda79088f6 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1318 microversion: 2.1 time: 0.156066 Dec 15 13:46:15.541816 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 563/1131] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:15 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:15.550205 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-99485d36-56af-44e8-ba69-0a6141192214 req-76cd835c-978f-467d-93b1-179b529cb721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7a269b-119d-48a4-a6fe-4b2478213d75", "tag": "9127b87e-2f38-46fa-8700-9e9ae9ba1ee6"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:46:15.552286 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:46:15.552286 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:46:15.567600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-99485d36-56af-44e8-ba69-0a6141192214 req-76cd835c-978f-467d-93b1-179b529cb721 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:15.568227 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-99485d36-56af-44e8-ba69-0a6141192214 req-76cd835c-978f-467d-93b1-179b529cb721 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:15.580738 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-99485d36-56af-44e8-ba69-0a6141192214 req-76cd835c-978f-467d-93b1-179b529cb721 service nova] Creating event network-changed:9127b87e-2f38-46fa-8700-9e9ae9ba1ee6 for instance 6c7a269b-119d-48a4-a6fe-4b2478213d75 on hv-cinder-81322 Dec 15 13:46:15.587369 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-99485d36-56af-44e8-ba69-0a6141192214 req-76cd835c-978f-467d-93b1-179b529cb721 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041001 Dec 15 13:46:15.587949 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 569/1132] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:46:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:46:16.558733 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-c6896de6-8770-4655-b79a-00e634ddd15c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:16.559360 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-c6896de6-8770-4655-b79a-00e634ddd15c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:16.565688 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c6896de6-8770-4655-b79a-00e634ddd15c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:16.566168 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c6896de6-8770-4655-b79a-00e634ddd15c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:16.566934 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c6896de6-8770-4655-b79a-00e634ddd15c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:16.567360 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-c6896de6-8770-4655-b79a-00e634ddd15c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:16.700980 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-c6896de6-8770-4655-b79a-00e634ddd15c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:16.708140 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-c6896de6-8770-4655-b79a-00e634ddd15c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1318 microversion: 2.1 time: 0.153152 Dec 15 13:46:16.708691 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 564/1133] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:16 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:17.724769 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-04242417-f4ef-4442-bba1-fea06b659298 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:17.725454 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-04242417-f4ef-4442-bba1-fea06b659298 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:17.731808 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-04242417-f4ef-4442-bba1-fea06b659298 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:17.732252 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-04242417-f4ef-4442-bba1-fea06b659298 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:17.733017 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-04242417-f4ef-4442-bba1-fea06b659298 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:17.733445 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-04242417-f4ef-4442-bba1-fea06b659298 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:17.866714 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-04242417-f4ef-4442-bba1-fea06b659298 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:17.873866 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-04242417-f4ef-4442-bba1-fea06b659298 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1318 microversion: 2.1 time: 0.153239 Dec 15 13:46:17.874426 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 570/1134] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:17 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:18.890728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-662aa64b-629c-4584-8fa6-77d862ceff4f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:18.891329 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-662aa64b-629c-4584-8fa6-77d862ceff4f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:18.897517 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-662aa64b-629c-4584-8fa6-77d862ceff4f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:18.897997 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-662aa64b-629c-4584-8fa6-77d862ceff4f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:18.898771 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-662aa64b-629c-4584-8fa6-77d862ceff4f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:18.899201 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-662aa64b-629c-4584-8fa6-77d862ceff4f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:19.026924 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-662aa64b-629c-4584-8fa6-77d862ceff4f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:19.033942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-662aa64b-629c-4584-8fa6-77d862ceff4f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1318 microversion: 2.1 time: 0.146893 Dec 15 13:46:19.034489 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 565/1135] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:18 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:20.052172 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-deef0f9f-52ca-47be-8cb0-cef91faf5e2f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:20.053082 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-deef0f9f-52ca-47be-8cb0-cef91faf5e2f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:20.059156 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-deef0f9f-52ca-47be-8cb0-cef91faf5e2f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:20.059628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-deef0f9f-52ca-47be-8cb0-cef91faf5e2f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:20.060397 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-deef0f9f-52ca-47be-8cb0-cef91faf5e2f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:20.060828 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-deef0f9f-52ca-47be-8cb0-cef91faf5e2f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:20.189389 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-deef0f9f-52ca-47be-8cb0-cef91faf5e2f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:20.197126 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-deef0f9f-52ca-47be-8cb0-cef91faf5e2f tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1318 microversion: 2.1 time: 0.148659 Dec 15 13:46:20.197689 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 571/1136] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:20 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:21.214094 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-a5aee404-c542-40df-a20a-8924b241d1f9 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:21.214699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-a5aee404-c542-40df-a20a-8924b241d1f9 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:21.220911 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a5aee404-c542-40df-a20a-8924b241d1f9 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:21.221352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a5aee404-c542-40df-a20a-8924b241d1f9 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:21.222148 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a5aee404-c542-40df-a20a-8924b241d1f9 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:21.222577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-a5aee404-c542-40df-a20a-8924b241d1f9 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:21.353669 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-a5aee404-c542-40df-a20a-8924b241d1f9 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:21.360969 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-a5aee404-c542-40df-a20a-8924b241d1f9 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1318 microversion: 2.1 time: 0.150644 Dec 15 13:46:21.361513 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 566/1137] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:21 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:21.802148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-6e816e89-2b2f-41e5-896c-e49cc67d4660 req-5572d277-2769-447b-8cc3-cd57cd7d8563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7a269b-119d-48a4-a6fe-4b2478213d75", "name": "network-vif-plugged", "status": "completed", "tag": "9127b87e-2f38-46fa-8700-9e9ae9ba1ee6"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:46:21.803747 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:46:21.803747 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:46:21.811320 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-6e816e89-2b2f-41e5-896c-e49cc67d4660 req-5572d277-2769-447b-8cc3-cd57cd7d8563 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:21.811757 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-6e816e89-2b2f-41e5-896c-e49cc67d4660 req-5572d277-2769-447b-8cc3-cd57cd7d8563 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:21.823264 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-6e816e89-2b2f-41e5-896c-e49cc67d4660 req-5572d277-2769-447b-8cc3-cd57cd7d8563 service nova] Creating event network-vif-plugged:9127b87e-2f38-46fa-8700-9e9ae9ba1ee6 for instance 6c7a269b-119d-48a4-a6fe-4b2478213d75 on hv-cinder-81322 Dec 15 13:46:21.827904 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-6e816e89-2b2f-41e5-896c-e49cc67d4660 req-5572d277-2769-447b-8cc3-cd57cd7d8563 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029395 Dec 15 13:46:21.828501 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 572/1138] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:46:22.378437 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ac68e2d2-d72d-4a6e-b32e-baf1a22c5151 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:22.379037 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ac68e2d2-d72d-4a6e-b32e-baf1a22c5151 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:22.385220 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ac68e2d2-d72d-4a6e-b32e-baf1a22c5151 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:22.385660 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ac68e2d2-d72d-4a6e-b32e-baf1a22c5151 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:22.386507 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ac68e2d2-d72d-4a6e-b32e-baf1a22c5151 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:22.387193 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ac68e2d2-d72d-4a6e-b32e-baf1a22c5151 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:22.515407 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-ac68e2d2-d72d-4a6e-b32e-baf1a22c5151 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:22.522647 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ac68e2d2-d72d-4a6e-b32e-baf1a22c5151 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1318 microversion: 2.1 time: 0.147911 Dec 15 13:46:22.523209 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 567/1139] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:22 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:23.540820 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-8aff8b8f-0021-47b5-a9a9-705dd0441b44 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:46:23.541508 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-8aff8b8f-0021-47b5-a9a9-705dd0441b44 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:23.547521 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8aff8b8f-0021-47b5-a9a9-705dd0441b44 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:23.547962 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8aff8b8f-0021-47b5-a9a9-705dd0441b44 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:23.548722 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8aff8b8f-0021-47b5-a9a9-705dd0441b44 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:23.549145 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-8aff8b8f-0021-47b5-a9a9-705dd0441b44 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:23.686937 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-8aff8b8f-0021-47b5-a9a9-705dd0441b44 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:46:23.694785 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-8aff8b8f-0021-47b5-a9a9-705dd0441b44 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1506 microversion: 2.1 time: 0.158390 Dec 15 13:46:23.695409 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 573/1140] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:46:23 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:46:39.581815 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:46:39.582352 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: Wed Dec 15 13:46:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:46:39.809640 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-014e5f98-9dd9-42f3-b21e-8765bb2f2eca tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cb40ba8-c464-42f8-9271-992aab5b08bf", "device": "/dev/sdb"}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:46:39.811268 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-014e5f98-9dd9-42f3-b21e-8765bb2f2eca tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:46:39.818248 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-014e5f98-9dd9-42f3-b21e-8765bb2f2eca tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:39.818702 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-014e5f98-9dd9-42f3-b21e-8765bb2f2eca tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:39.820012 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-014e5f98-9dd9-42f3-b21e-8765bb2f2eca tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:46:39.820446 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-014e5f98-9dd9-42f3-b21e-8765bb2f2eca tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:46:40.157159 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-014e5f98-9dd9-42f3-b21e-8765bb2f2eca tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "POST /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351107 Dec 15 13:46:40.157978 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 568/1141] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:46:39 2021] POST /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:47:02.651665 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4e2ddb0b-0784-4967-983b-9d0790a541e4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:02.652194 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4e2ddb0b-0784-4967-983b-9d0790a541e4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:02.658105 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4e2ddb0b-0784-4967-983b-9d0790a541e4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:02.658551 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4e2ddb0b-0784-4967-983b-9d0790a541e4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:02.659313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4e2ddb0b-0784-4967-983b-9d0790a541e4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:02.660123 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4e2ddb0b-0784-4967-983b-9d0790a541e4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:02.788672 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-4e2ddb0b-0784-4967-983b-9d0790a541e4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lazy-loading 'services' on Instance uuid 6c7a269b-119d-48a4-a6fe-4b2478213d75 {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:47:02.858011 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4e2ddb0b-0784-4967-983b-9d0790a541e4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75/os-volume_attachments/9cb40ba8-c464-42f8-9271-992aab5b08bf" status: 202 len: 0 microversion: 2.1 time: 0.210324 Dec 15 13:47:02.858678 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 574/1142] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:47:02 2021] DELETE /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75/os-volume_attachments/9cb40ba8-c464-42f8-9271-992aab5b08bf => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:47:03.969469 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-07b2ab35-922f-4791-b256-661b62c68818 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:03.970160 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-07b2ab35-922f-4791-b256-661b62c68818 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:03.980942 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-07b2ab35-922f-4791-b256-661b62c68818 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:03.981743 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-07b2ab35-922f-4791-b256-661b62c68818 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:03.983173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-07b2ab35-922f-4791-b256-661b62c68818 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:03.983963 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-07b2ab35-922f-4791-b256-661b62c68818 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:04.012709 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-07b2ab35-922f-4791-b256-661b62c68818 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Going to try to terminate instance {{(pid=122611) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:47:04.086868 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-07b2ab35-922f-4791-b256-661b62c68818 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 204 len: 0 microversion: 2.1 time: 0.121163 Dec 15 13:47:04.087445 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 569/1143] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:47:03 2021] DELETE /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:47:04.096950 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-7fd75cca-8044-42b0-879a-041c102187f1 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:04.097481 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-7fd75cca-8044-42b0-879a-041c102187f1 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:04.104348 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7fd75cca-8044-42b0-879a-041c102187f1 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:04.104795 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7fd75cca-8044-42b0-879a-041c102187f1 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:04.105584 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7fd75cca-8044-42b0-879a-041c102187f1 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:04.106148 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-7fd75cca-8044-42b0-879a-041c102187f1 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:04.235895 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-7fd75cca-8044-42b0-879a-041c102187f1 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:04.243680 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-7fd75cca-8044-42b0-879a-041c102187f1 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1512 microversion: 2.1 time: 0.151433 Dec 15 13:47:04.244233 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 575/1144] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:04 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:05.261406 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-22645a2e-8e39-475a-9185-e9bb586cc0f4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:05.262026 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-22645a2e-8e39-475a-9185-e9bb586cc0f4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:05.268495 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-22645a2e-8e39-475a-9185-e9bb586cc0f4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:05.268961 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-22645a2e-8e39-475a-9185-e9bb586cc0f4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:05.269728 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-22645a2e-8e39-475a-9185-e9bb586cc0f4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:05.270181 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-22645a2e-8e39-475a-9185-e9bb586cc0f4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:05.400785 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-22645a2e-8e39-475a-9185-e9bb586cc0f4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:05.407977 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-22645a2e-8e39-475a-9185-e9bb586cc0f4 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1512 microversion: 2.1 time: 0.151268 Dec 15 13:47:05.408525 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 570/1145] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:05 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:06.225371 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [req-c417e619-2f78-4071-b443-77284648d244 req-3d4ab157-e3fd-4b08-bb4b-cef8982d98b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7a269b-119d-48a4-a6fe-4b2478213d75", "name": "network-vif-deleted", "tag": "9127b87e-2f38-46fa-8700-9e9ae9ba1ee6"}]} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:47:06.227937 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:47:06.227937 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: warnings.warn(msg) Dec 15 13:47:06.236922 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-c417e619-2f78-4071-b443-77284648d244 req-3d4ab157-e3fd-4b08-bb4b-cef8982d98b6 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:06.237367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [req-c417e619-2f78-4071-b443-77284648d244 req-3d4ab157-e3fd-4b08-bb4b-cef8982d98b6 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:06.248481 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.compute.server_external_events [req-c417e619-2f78-4071-b443-77284648d244 req-3d4ab157-e3fd-4b08-bb4b-cef8982d98b6 service nova] Creating event network-vif-deleted:9127b87e-2f38-46fa-8700-9e9ae9ba1ee6 for instance 6c7a269b-119d-48a4-a6fe-4b2478213d75 on hv-cinder-81322 Dec 15 13:47:06.254234 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [req-c417e619-2f78-4071-b443-77284648d244 req-3d4ab157-e3fd-4b08-bb4b-cef8982d98b6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033356 Dec 15 13:47:06.255120 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 576/1146] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:47:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:47:06.425973 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:06.426577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:06.432725 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:06.433173 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:06.433981 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:06.434414 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:06.465509 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:06.465986 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:06.466432 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lazy-loading 'fault' on Instance uuid 6c7a269b-119d-48a4-a6fe-4b2478213d75 {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:47:06.522149 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:06.533092 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-19a86eb2-8b78-47cd-9631-52a687a11c7b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 200 len: 1308 microversion: 2.1 time: 0.110703 Dec 15 13:47:06.533963 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 571/1147] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:06 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:07.553143 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:07.554401 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: 6c7a269b-119d-48a4-a6fe-4b2478213d75] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:07.560631 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:07.561079 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:07.561886 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:07.562406 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:07.575908 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.wsgi [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] HTTP exception thrown: Instance 6c7a269b-119d-48a4-a6fe-4b2478213d75 could not be found. Dec 15 13:47:07.576494 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Returning 404 to user: Instance 6c7a269b-119d-48a4-a6fe-4b2478213d75 could not be found. {{(pid=122612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:47:07.577313 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-d809c259-b0bf-4fe7-a1a5-31c10e175f8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75" status: 404 len: 111 microversion: 2.1 time: 0.028687 Dec 15 13:47:07.577858 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 577/1148] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:07 2021] GET /compute/v2.1/servers/6c7a269b-119d-48a4-a6fe-4b2478213d75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:47:15.280577 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2013908412", "imageRef": "361169e3-84cc-4c65-a9df-303c7a852926", "flavorRef": "452", "networks": [{"uuid": "b270e446-48ff-4f05-938d-bcf4e2d6f813"}]}} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:47:15.330121 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.network.neutron [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] validate_networks() for [('b270e446-48ff-4f05-938d-bcf4e2d6f813', None, None, None, None, None)] {{(pid=122611) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 13:47:15.682363 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Flavor limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 13:47:15.682782 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Image limits 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 13:47:15.683244 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Flavor pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 13:47:15.683663 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Image pref 0:0:0 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 13:47:15.684090 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.virt.hardware [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 13:47:15.692466 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:15.692903 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:15.693699 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:15.694153 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:15.710519 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Getting quotas for project a6ee752240d24f6985d8247a0cf949d3. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 13:47:15.714370 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.quota [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Getting quotas for user b0ae2089722840cbb6a10b84f1ac08ed and project a6ee752240d24f6985d8247a0cf949d3. Resources: {'ram', 'cores', 'instances'} {{(pid=122611) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 13:47:15.724996 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Going to run 1 instances... {{(pid=122611) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 13:47:15.728068 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='361169e3-84cc-4c65-a9df-303c7a852926',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 13:47:15.775551 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-3912f0f0-fe48-43a3-b3b2-d86fd80d1b3d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498471 Dec 15 13:47:15.776139 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 572/1149] 10.222.0.83 () {60 vars in 1146 bytes} [Wed Dec 15 13:47:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 13:47:15.785894 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9fd13494-9c68-43b6-bbac-38fc377e454e tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:15.786496 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9fd13494-9c68-43b6-bbac-38fc377e454e tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:15.842181 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9fd13494-9c68-43b6-bbac-38fc377e454e tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:15.848628 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9fd13494-9c68-43b6-bbac-38fc377e454e tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1219 microversion: 2.1 time: 0.066514 Dec 15 13:47:15.849184 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 578/1150] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:15 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:16.871206 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-dfcf0158-d7b2-452d-ad42-1f2f13d0dc05 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:16.871816 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-dfcf0158-d7b2-452d-ad42-1f2f13d0dc05 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:16.878243 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dfcf0158-d7b2-452d-ad42-1f2f13d0dc05 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:16.878691 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dfcf0158-d7b2-452d-ad42-1f2f13d0dc05 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:16.879475 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dfcf0158-d7b2-452d-ad42-1f2f13d0dc05 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:16.879904 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-dfcf0158-d7b2-452d-ad42-1f2f13d0dc05 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:16.940760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-dfcf0158-d7b2-452d-ad42-1f2f13d0dc05 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:16.948557 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-dfcf0158-d7b2-452d-ad42-1f2f13d0dc05 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1277 microversion: 2.1 time: 0.081639 Dec 15 13:47:16.949120 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 573/1151] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:16 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:17.965952 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-39ca24c4-c094-4689-aca8-8d911bf38724 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:17.966690 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-39ca24c4-c094-4689-aca8-8d911bf38724 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:17.973349 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-39ca24c4-c094-4689-aca8-8d911bf38724 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:17.973812 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-39ca24c4-c094-4689-aca8-8d911bf38724 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:17.974610 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-39ca24c4-c094-4689-aca8-8d911bf38724 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:17.975288 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-39ca24c4-c094-4689-aca8-8d911bf38724 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:18.090931 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-98cce044-d74e-401e-841f-f1d9178f58d1 req-c0ba6dfd-ce9a-4497-840f-918267e0f441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf", "tag": "e79b631a-8a11-4902-b87c-697becc30c17"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:47:18.092794 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:47:18.092794 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:47:18.112183 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-98cce044-d74e-401e-841f-f1d9178f58d1 req-c0ba6dfd-ce9a-4497-840f-918267e0f441 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:18.114050 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-39ca24c4-c094-4689-aca8-8d911bf38724 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:18.114234 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-98cce044-d74e-401e-841f-f1d9178f58d1 req-c0ba6dfd-ce9a-4497-840f-918267e0f441 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:18.121787 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-39ca24c4-c094-4689-aca8-8d911bf38724 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1319 microversion: 2.1 time: 0.159707 Dec 15 13:47:18.122893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 579/1152] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:17 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:18.126734 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-98cce044-d74e-401e-841f-f1d9178f58d1 req-c0ba6dfd-ce9a-4497-840f-918267e0f441 service nova] Creating event network-changed:e79b631a-8a11-4902-b87c-697becc30c17 for instance ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf on hv-cinder-81322 Dec 15 13:47:18.131914 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-98cce044-d74e-401e-841f-f1d9178f58d1 req-c0ba6dfd-ce9a-4497-840f-918267e0f441 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044978 Dec 15 13:47:18.132583 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 574/1153] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:47:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:47:19.139561 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-b493a53d-e67e-41ab-90f0-72ac31d5766c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:19.140098 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-b493a53d-e67e-41ab-90f0-72ac31d5766c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:19.146427 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b493a53d-e67e-41ab-90f0-72ac31d5766c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:19.146869 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b493a53d-e67e-41ab-90f0-72ac31d5766c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:19.147641 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b493a53d-e67e-41ab-90f0-72ac31d5766c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:19.148069 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-b493a53d-e67e-41ab-90f0-72ac31d5766c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:19.276740 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-b493a53d-e67e-41ab-90f0-72ac31d5766c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:19.284056 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-b493a53d-e67e-41ab-90f0-72ac31d5766c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1319 microversion: 2.1 time: 0.148322 Dec 15 13:47:19.284610 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 580/1154] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:19 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:47:20.301992 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-304baff3-c8b7-4393-a1f6-41d62975ce8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:20.302598 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-304baff3-c8b7-4393-a1f6-41d62975ce8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:20.309576 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-304baff3-c8b7-4393-a1f6-41d62975ce8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:20.310071 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-304baff3-c8b7-4393-a1f6-41d62975ce8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:20.310830 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-304baff3-c8b7-4393-a1f6-41d62975ce8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:20.311256 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-304baff3-c8b7-4393-a1f6-41d62975ce8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:20.438369 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-304baff3-c8b7-4393-a1f6-41d62975ce8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:20.445426 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-304baff3-c8b7-4393-a1f6-41d62975ce8a tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1319 microversion: 2.1 time: 0.147569 Dec 15 13:47:20.446766 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 575/1155] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:20 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:21.462835 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-36477373-2fd2-44dd-a3ad-a340f190ec37 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:21.463495 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-36477373-2fd2-44dd-a3ad-a340f190ec37 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:21.469600 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-36477373-2fd2-44dd-a3ad-a340f190ec37 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:21.470071 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-36477373-2fd2-44dd-a3ad-a340f190ec37 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:21.470840 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-36477373-2fd2-44dd-a3ad-a340f190ec37 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:21.471265 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-36477373-2fd2-44dd-a3ad-a340f190ec37 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:21.601441 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-36477373-2fd2-44dd-a3ad-a340f190ec37 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:21.608572 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-36477373-2fd2-44dd-a3ad-a340f190ec37 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1319 microversion: 2.1 time: 0.150041 Dec 15 13:47:21.609122 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 581/1156] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:21 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:22.625242 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-e9db2588-05c3-4712-8771-b51d71abf882 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:22.625879 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-e9db2588-05c3-4712-8771-b51d71abf882 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:22.632299 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9db2588-05c3-4712-8771-b51d71abf882 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:22.632781 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9db2588-05c3-4712-8771-b51d71abf882 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:22.633670 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9db2588-05c3-4712-8771-b51d71abf882 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:22.634075 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-e9db2588-05c3-4712-8771-b51d71abf882 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:22.761847 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-e9db2588-05c3-4712-8771-b51d71abf882 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:22.769229 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-e9db2588-05c3-4712-8771-b51d71abf882 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1319 microversion: 2.1 time: 0.147639 Dec 15 13:47:22.769807 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 576/1157] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:22 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:23.786586 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-9dd189dc-ee4a-4e50-a5ef-e1564ed6004c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:23.787187 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-9dd189dc-ee4a-4e50-a5ef-e1564ed6004c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:23.793977 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9dd189dc-ee4a-4e50-a5ef-e1564ed6004c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:23.794426 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9dd189dc-ee4a-4e50-a5ef-e1564ed6004c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:23.795305 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9dd189dc-ee4a-4e50-a5ef-e1564ed6004c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:23.795740 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-9dd189dc-ee4a-4e50-a5ef-e1564ed6004c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:23.920758 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-9dd189dc-ee4a-4e50-a5ef-e1564ed6004c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:23.927965 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-9dd189dc-ee4a-4e50-a5ef-e1564ed6004c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1319 microversion: 2.1 time: 0.145086 Dec 15 13:47:23.928514 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 582/1158] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:23 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:24.185486 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-3a540562-003f-483a-a115-83675bfffd1b req-4bec178e-99c1-46cd-9ce5-2b70a2f7f7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf", "name": "network-vif-plugged", "status": "completed", "tag": "e79b631a-8a11-4902-b87c-697becc30c17"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:47:24.187267 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:47:24.187267 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:47:24.194002 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-3a540562-003f-483a-a115-83675bfffd1b req-4bec178e-99c1-46cd-9ce5-2b70a2f7f7d9 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:24.194441 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-3a540562-003f-483a-a115-83675bfffd1b req-4bec178e-99c1-46cd-9ce5-2b70a2f7f7d9 service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:24.206457 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-3a540562-003f-483a-a115-83675bfffd1b req-4bec178e-99c1-46cd-9ce5-2b70a2f7f7d9 service nova] Creating event network-vif-plugged:e79b631a-8a11-4902-b87c-697becc30c17 for instance ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf on hv-cinder-81322 Dec 15 13:47:24.212019 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-3a540562-003f-483a-a115-83675bfffd1b req-4bec178e-99c1-46cd-9ce5-2b70a2f7f7d9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089737 Dec 15 13:47:24.212605 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 577/1159] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:47:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:47:24.945401 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-e936d8f5-c031-4552-b3bf-067486715cef tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:24.946038 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-e936d8f5-c031-4552-b3bf-067486715cef tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:24.952275 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e936d8f5-c031-4552-b3bf-067486715cef tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:24.952686 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e936d8f5-c031-4552-b3bf-067486715cef tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:24.953462 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e936d8f5-c031-4552-b3bf-067486715cef tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:24.953931 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-e936d8f5-c031-4552-b3bf-067486715cef tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:25.082883 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-e936d8f5-c031-4552-b3bf-067486715cef tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:25.090769 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-e936d8f5-c031-4552-b3bf-067486715cef tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1319 microversion: 2.1 time: 0.149038 Dec 15 13:47:25.091354 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 583/1160] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:24 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:26.108787 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-29c80d78-4f26-445c-bb30-81ae787545ed tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:26.109479 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-29c80d78-4f26-445c-bb30-81ae787545ed tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:26.115661 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-29c80d78-4f26-445c-bb30-81ae787545ed tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:26.116111 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-29c80d78-4f26-445c-bb30-81ae787545ed tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:26.116885 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-29c80d78-4f26-445c-bb30-81ae787545ed tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:26.117334 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-29c80d78-4f26-445c-bb30-81ae787545ed tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:26.245075 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-29c80d78-4f26-445c-bb30-81ae787545ed tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:26.252240 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-29c80d78-4f26-445c-bb30-81ae787545ed tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1506 microversion: 2.1 time: 0.148048 Dec 15 13:47:26.252795 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 578/1161] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:26 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:26.268878 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-527a0fa1-c31b-4d4d-a1f3-a8b7fd7d48bd tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "236cbafd-73c9-4e54-bbfe-0f50ad4e07fa", "device": "/dev/sdb"}} {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:47:26.270497 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-527a0fa1-c31b-4d4d-a1f3-a8b7fd7d48bd tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:26.277115 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-527a0fa1-c31b-4d4d-a1f3-a8b7fd7d48bd tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:26.277561 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-527a0fa1-c31b-4d4d-a1f3-a8b7fd7d48bd tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:26.278367 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-527a0fa1-c31b-4d4d-a1f3-a8b7fd7d48bd tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:26.278807 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-527a0fa1-c31b-4d4d-a1f3-a8b7fd7d48bd tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:26.499100 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-527a0fa1-c31b-4d4d-a1f3-a8b7fd7d48bd tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "POST /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.233793 Dec 15 13:47:26.499707 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 584/1162] 10.222.0.83 () {60 vars in 1322 bytes} [Wed Dec 15 13:47:26 2021] POST /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf/os-volume_attachments => generated 194 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 13:47:44.657107 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-ca14d68e-ebcb-43ba-bbf3-a22cf47a5cab tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:44.657594 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-ca14d68e-ebcb-43ba-bbf3-a22cf47a5cab tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:44.663904 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ca14d68e-ebcb-43ba-bbf3-a22cf47a5cab tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:44.664345 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ca14d68e-ebcb-43ba-bbf3-a22cf47a5cab tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:44.665595 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ca14d68e-ebcb-43ba-bbf3-a22cf47a5cab tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:44.666062 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-ca14d68e-ebcb-43ba-bbf3-a22cf47a5cab tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:44.748760 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.objects.instance [None req-ca14d68e-ebcb-43ba-bbf3-a22cf47a5cab tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lazy-loading 'services' on Instance uuid ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf {{(pid=122611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:47:44.816365 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-ca14d68e-ebcb-43ba-bbf3-a22cf47a5cab tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf/os-volume_attachments/236cbafd-73c9-4e54-bbfe-0f50ad4e07fa" status: 202 len: 0 microversion: 2.1 time: 0.162688 Dec 15 13:47:44.816958 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 579/1163] 10.222.0.83 () {58 vars in 1415 bytes} [Wed Dec 15 13:47:44 2021] DELETE /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf/os-volume_attachments/236cbafd-73c9-4e54-bbfe-0f50ad4e07fa => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 13:47:45.931582 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-65921d0c-9037-4765-99c3-4b663e01918d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:45.932174 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-65921d0c-9037-4765-99c3-4b663e01918d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:45.938807 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-65921d0c-9037-4765-99c3-4b663e01918d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:45.939261 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-65921d0c-9037-4765-99c3-4b663e01918d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:45.940046 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-65921d0c-9037-4765-99c3-4b663e01918d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:45.940485 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-65921d0c-9037-4765-99c3-4b663e01918d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:45.966117 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-65921d0c-9037-4765-99c3-4b663e01918d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Going to try to terminate instance {{(pid=122612) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 13:47:46.045796 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-65921d0c-9037-4765-99c3-4b663e01918d tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 204 len: 0 microversion: 2.1 time: 0.118867 Dec 15 13:47:46.046709 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 585/1164] 10.222.0.83 () {58 vars in 1238 bytes} [Wed Dec 15 13:47:45 2021] DELETE /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 13:47:46.057326 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-0d567cef-72fd-4a95-b6c1-9864d38181ea tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:46.058065 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-0d567cef-72fd-4a95-b6c1-9864d38181ea tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:46.066366 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0d567cef-72fd-4a95-b6c1-9864d38181ea tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:46.067018 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0d567cef-72fd-4a95-b6c1-9864d38181ea tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:46.068237 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0d567cef-72fd-4a95-b6c1-9864d38181ea tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:46.069091 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-0d567cef-72fd-4a95-b6c1-9864d38181ea tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:46.228784 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.policy [None req-0d567cef-72fd-4a95-b6c1-9864d38181ea tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122611) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:46.236205 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-0d567cef-72fd-4a95-b6c1-9864d38181ea tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1512 microversion: 2.1 time: 0.184035 Dec 15 13:47:46.236775 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 580/1165] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:46 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 13:47:47.258353 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-f9dd0290-0425-4b8b-8d4b-bcd64c2d413c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:47.259654 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-f9dd0290-0425-4b8b-8d4b-bcd64c2d413c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:47.265803 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f9dd0290-0425-4b8b-8d4b-bcd64c2d413c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:47.266247 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f9dd0290-0425-4b8b-8d4b-bcd64c2d413c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:47.267005 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f9dd0290-0425-4b8b-8d4b-bcd64c2d413c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:47.267430 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-f9dd0290-0425-4b8b-8d4b-bcd64c2d413c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:47.393934 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-f9dd0290-0425-4b8b-8d4b-bcd64c2d413c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:47.401574 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-f9dd0290-0425-4b8b-8d4b-bcd64c2d413c tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1512 microversion: 2.1 time: 0.147025 Dec 15 13:47:47.402442 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 586/1166] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:47 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:48.214398 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [req-57bdd9ba-feeb-4da5-ba3b-1ef234fc33b8 req-5acf8f2b-4e66-436c-82b0-3d745c4c8c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf", "name": "network-vif-deleted", "tag": "e79b631a-8a11-4902-b87c-697becc30c17"}]} {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 13:47:48.216044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:47:48.216044 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: warnings.warn(msg) Dec 15 13:47:48.223329 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-57bdd9ba-feeb-4da5-ba3b-1ef234fc33b8 req-5acf8f2b-4e66-436c-82b0-3d745c4c8c2e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:48.223863 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [req-57bdd9ba-feeb-4da5-ba3b-1ef234fc33b8 req-5acf8f2b-4e66-436c-82b0-3d745c4c8c2e service nova] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:48.235402 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.compute.server_external_events [req-57bdd9ba-feeb-4da5-ba3b-1ef234fc33b8 req-5acf8f2b-4e66-436c-82b0-3d745c4c8c2e service nova] Creating event network-vif-deleted:e79b631a-8a11-4902-b87c-697becc30c17 for instance ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf on hv-cinder-81322 Dec 15 13:47:48.240430 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [req-57bdd9ba-feeb-4da5-ba3b-1ef234fc33b8 req-5acf8f2b-4e66-436c-82b0-3d745c4c8c2e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088937 Dec 15 13:47:48.241096 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 581/1167] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Dec 15 13:47:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 13:47:48.418991 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.api.openstack.wsgi [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:48.419578 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.compute.api [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122612) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:48.425893 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:48.426342 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:48.427110 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:48.427537 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:48.459844 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:48.460189 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG oslo_concurrency.lockutils [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:48.460629 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.objects.instance [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lazy-loading 'fault' on Instance uuid ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf {{(pid=122612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 13:47:48.499895 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: DEBUG nova.policy [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae2089722840cbb6a10b84f1ac08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee752240d24f6985d8247a0cf949d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122612) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 13:47:48.510447 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO nova.api.openstack.requestlog [None req-4a60ba6a-c736-42f7-9eaa-336278e4f95b tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 200 len: 1309 microversion: 2.1 time: 0.094570 Dec 15 13:47:48.511150 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: [pid: 122612|app: 0|req: 587/1168] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:48 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 13:47:49.529399 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Calling method '>' {{(pid=122611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 13:47:49.530100 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.compute.api [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] [instance: ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf] Fetching instance by UUID {{(pid=122611) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 13:47:49.536172 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:49.536638 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:49.537400 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 13:47:49.537880 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG oslo_concurrency.lockutils [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Lock "ca99323b-21e3-4055-ab5d-fe0a9982137e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 13:47:49.551018 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.wsgi [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] HTTP exception thrown: Instance ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf could not be found. Dec 15 13:47:49.551589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: DEBUG nova.api.openstack.wsgi [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] Returning 404 to user: Instance ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf could not be found. {{(pid=122611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 13:47:49.552385 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO nova.api.openstack.requestlog [None req-6d57de1c-59eb-4072-aba5-43fdfd39bd93 tempest-VolumesSnapshotTestJSON-252009658 tempest-VolumesSnapshotTestJSON-252009658-project] 10.222.0.83 "GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf" status: 404 len: 111 microversion: 2.1 time: 0.027452 Dec 15 13:47:49.552928 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: [pid: 122611|app: 0|req: 582/1169] 10.222.0.83 () {58 vars in 1235 bytes} [Wed Dec 15 13:47:49 2021] GET /compute/v2.1/servers/ca1102e5-9a25-414a-8cb7-bbb2a67b1cbf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 13:49:59.601117 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:49:59.601915 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: Wed Dec 15 13:49:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:50:24.693470 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:50:24.693983 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: Wed Dec 15 13:50:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:50:30.581604 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:50:30.582295 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: Wed Dec 15 13:50:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:51:30.014978 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:51:30.015670 dv-cinder-813228-4-iscsi devstack@n-api.service[122612]: Wed Dec 15 13:51:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:51:32.494809 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:51:32.495371 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: Wed Dec 15 13:51:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:53:19.619897 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:53:19.620625 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: Wed Dec 15 13:53:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 13:53:25.813589 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 13:53:25.814144 dv-cinder-813228-4-iscsi devstack@n-api.service[122611]: Wed Dec 15 13:53:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!